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Abstract 

We review the observations and the basic laws describing the essential aspects of collective motion - being 
one of the most common and spectacular manifestation of coordinated behavior. Our aim is to provide 
a balanced discussion of the various facets of this highly multidisciplinary field, including experiments, 
mathematical methods and models for simulations, so that readers with a variety of background could get 
both the basics and a broader, more detailed picture of the field. The observations we report on include 
systems consisting of units ranging from macromolecules through metallic rods and robots to groups of 
animals and people. Some emphasis is put on models that are simple and realistic enough to reproduce 
the numerous related observations and are useful for developing concepts for a better understanding of 
the complexity of systems consisting of many simultaneously moving entities. As such, these models allow 
the establishing of a few fundamental principles of flocking. In particular, it is demonstrated, that in 
spite of considerable differences, a number of deep analogies exist between equilibrium statistical physics 
systems and those made of self-propelled (in most cases living) units. In both cases only a few well 
defined macroscopic/collective states occur and the transitions between these states follow a similar scenario, 
involving discontinuity and algebraic divergences. 
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1 Introduction 

Most of us must have been fascinated by the eye- 
catching displays of collectively moving animals. 
Schools of fish can move in a rather orderly fash- 
ion or change direction amazingly abruptly. Under 
the pressure from a nearby predator the same fish 
can swirl like a vehemently stirred fluid. Flocks of 
hundreds of starlings can fiy to the fields as a uni- 
formly moving group, but then, after returning to 
their roosting site, produce turbulent, puzzling aerial 
displays. There are a huge number of further exam- 
ples both from the living and the non-living world for 
the rich behavior in systems consisting of interacting, 
permanently moving units. 

Although persistent motion is one of the conspic- 
uous features of life, recently several physical and 
chemical systems have also been shown to possess 
interacting, "self-propelled" units. Examples in- 
clude rods or disks of various kinds on a vibrat- 
2003L iKudrolh et al 



ing table iBlair et al 
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The concept of the present review is to on one hand 
introduce the readers to the field of flocking by dis- 
cussing the most influential "classic" works on collec- 
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tive motion as well as providing an overview of the 
state of the art for those who consider doing research 
in this thriving multidisciplinary area. We have put 
a special stress on coherence and aimed at presenting 
a balanced account of the various experimental and 
theoretical approaches. 

In addition to presenting the most appealing re- 
sults from the quickly growing related literature we 
also deliver a critical discussion of the emerging pic- 
ture and summarize our present understanding of 
flocking phenomena in the form of a systematic phe- 
nomenological description of the results obtained so 
far. In turn, such a description may become a good 
starting point for developing a unified theoretical 
treatment of the main laws of collective motion. 

1.1 The basic questions we address 

Are these observed motion patterns system specific? 
Such a conclusion would be quite common in biol- 
ogy. Or, alternatively, are there only a few typical 
classes which all of the collective motion patterns be- 
long to? This would be a familiar thought for a sta- 
tistical physicist dealing with systems of an enormous 
number of molecules in equilibrium. In fact, collec- 
tive motion is one of the manifestations of a more 
general class of phenomena called collective behavior 
Vicsekl - linnTat . The studies of the latter have iden- 



tified a few general laws related to how new, more 
complex qualitative features emerge as many simpler 
units are interacting. Throughout this review we con- 
sider collective motion as a phenomenon occurring in 
collections of similar, interacting units moving with 
about the same absolute velocity. In this interpreta- 
tion the source of energy making the motion possible 
(the ways the units gain momentum) and the condi- 
tions ensuring the similar absolute velocities are not 
relevant. 

There is an amazing variety of systems made of 
such units bridging over many orders of magnitude 
in size. In addition, the nature of the entities in such 
systems can be purely physical, chemical as well as 
biological. Will they still exhibit the same motion 
patterns? If yes, what are these patterns and are 
there any underlying universal principles predicting 
that this has to be so (e.g., non-conservation of mo- 



ments during interactions)? 

In Fig. [U we show a gallery of pictures representing 
a few of the many possible examples of the variety 
of collective motion patterns occurring in a highly 
diverse selection of biological systems. 

1.2 Collective behavior 

In a system consisting of many similar units (such 
as many molecules, but also, flocks of birds) the in- 
teractions between the units can be simple (attrac- 
tion/repulsion) or more complex (combinations of 
simple interactions) and can occur between neigh- 
bors in space or in an underlying network. Under 
some conditions, transitions can occur during which 
the objects adopt a pattern of behavior almost com- 
pletely determined by the collective effects due to the 
other units in the system. The main feature of col- 
lective behavior is that an individual unit's action is 
dominated by the influence of the "others" - the unit 
behaves entirely differently from the way it would 
behave on its own. Such systems show interesting or- 
dering phenomena as the units simultaneously change 
their b ehavior to a common pattern (see, e.g.. lVicsek 
2001bl |). For example, a group of feeding pigeons 



randomly oriented on the ground will order them- 
selves into an orderly flying flock when leaving the 
scene after a big disturbance. 

Understanding new phenomena (in our case, the 
transitions in systems of collectively moving units) 
is usually achieved by relating them to known ones: 
a more complex system is understood by analyz- 
ing its simpler variants. In the 1970s, there was 
a breakthrough in statistical physics in the form of 
the 'renormalization group method' Wilson . 1975bj 
which gave physicists a deep theoretical understand- 
ing of a general type of phase transition. The theory 
showed that the main features of transitions in equi- 
librium systems are insensitive to the details of the 
interactions between the objects in a system. 

1.3 The main difference between equi- 
librium and self-propelled systems 

The essential difference between collective phenom- 
ena in standard statistical physics and biology is 
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Figure 1: (Color) A gallery of images related to col- 
lective behavior. Among others, it illustrates the pos- 
sible existence of very general behavioral patterns, 
(a) Wingless Locusts marching in the field, (b) A ro- 
tating colony of army ants, (c) A three-dimensional 
array of golden rays, (d) Fish are known to produce 
such vortices, (e) Before roosting, thousands of star- 
lings producing a fascinating aerial display. They are 
also trying to avoid a predator bird close to the cen- 
tral, finger-like structure, (f) A herd of zebra, (g) 
People spontaneously ordered into "traffic lanes" as 
they cross a pedestrian bridge in large numbers, (li) 
Although sheep are known to move very coherently, 
just as the corresponding theory predicts, when sim- 
ply hanging around (no motion), well developed ori- 
entational patterns cannot emerge. 



that the "collision rule" is principally altering in the 
two kinds of systems: in the latter ones it does not 
preserve the momenta (the momentum of two self- 
propelled particles before and after their interaction 
is not the same), assuming that the we consider only 
the system made of the self-propelled particles ex- 
clusively (i.e., we do not consider the changes in the 
environment). Here the expression "collision rule" 
stands for specifying how the states (velocities) of two 
individual units change during their interaction. In 
particular, the momentum dissipated to the medium 
and within the medium itself in the realistic systems 
we consider cannot be neglected. In equilibrium sys- 
tems, according to standard Newtonian mechanics 
the total momentum is preserved and that is how the 
well known Maxwellian velocity distribution is being 
built up from arbitrary initial conditions in a closed 
Galilean system. The mere condition of the units 
maintaining an approximate absolute velocity can be 
realized in an open system only and drives away the 
driven particles from any kind of equilibrium behav- 
ior. 

Energy, sustaining self-propulsion, can be intro- 
duced into the system in various ways: uniformly in 
the bulk, for example in the case of or Janus par- 
ticles, where the motion is ensur ed by a lase r beam 



which causes self-thermophoresis [Jiang et all . l2ninj 



at the boundaries (shaken rods), or at specific spatial 
points in space and time (fish). 

Currents are bound to be generated and the overall 
momentum is gradually increasing if the initial state 
is random (in this case the initial momentum is very 
small because the moments of the oppositely mov- 
ing particles cancel out). However, for this overall 
ordering to occur the random perturbations (acting 
against ordering) have to be small enough. 

Most remarkably, however, in spite of this princi- 
pal difference, a number of deep analogies can still be 
observed between equilibrium statistical physics sys- 
tems and those made of self-propelled (living) units. 
In both only a few well defined macroscopic/collective 
states occur and the transitions between these states 
follow a similar scenario as well (discontinuity, alge- 
braic divergences, etc). 



2.1 Principles and concepts 
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1.4 Goals to be achieved 

The approach of treating flocks, or civcn crowds, as 
systems of particles naturally leads to the idea of ap- 
plying the successful methods of statistical physics, 
such as computer simiilations or theories on scaling, 
to the detailed description of the collective behavior 
of organisms. Naturally, for better progress, obser- 
vations/experiments and modeling have to be inti- 
mately related. Indeed, over the past few decades, an 
increasingly growing number of significant attempts 
have been made to both observe and describe flocking 
as well as modeling (simulation) the most conspicu- 
ous features of the observed natural systems ranging 
from molecules to groups of mammals. 

It would be quite an achievement if we could es- 
tablish a systematic chart of the types of collective 
motion, since many times understanding is achieved 
through classification. There are reasons and argu- 
ments for thinking that the same patterns of collec- 
tive motion apply to the collection of molecules up 
to groups of humans. There must be some - still to 
be discovered - laws of such systems from which the 
above observation follows. 



2 Basics of the statistical me- 
chanics of flocking 

Throughout this overview the notion of flocking is 

used as a synonym of any kind of coherent motion 
of individual units. However, the notion of coher- 
ent motion needs some further elaboration since, as 
it turns out, it can be manifested in a number of 
specific ways. In any case, coherent or ordered mo- 
tion is assumed to be a counterpart of disordered, 
random motion. In the various models of flocking it 
emerges through a kind of transition (from disorder 
to order) as a function of the relevant parameter(s) of 
the models. To demonstrate more clearly this aspect 
of collective motion the best approach is to adopt a 
few related definitions motivated mainly by statisti- 
cal mechanics or statistical physics (the physics of 
many interacting molecules). 

However, before we turn to the discussion of the 
statistical mechanics aspects of collective motion we 



give a somewhat more detailed list of features char- 
acterizing flocking in general. Thus we assume that a 
system exhibiting collective motion is made of units 

• that are rather similar 

• moving with a nearly constant absolute velocity 
and are capable of changing their direction 

• interacting within a speciflc interaction range by 
changing their direction of motion, in a way in- 
volving an effective alignment 

• which are subject to a noise of a varying magni- 
tude 

2.1 Principles and concepts 

In a general sense, phase transition is a process, dur- 
ing which a system, consisting of a huge number of 
interacting particles, undergoes a transition from one 
phase to another, as a function of one or more exter- 
nal parameters. The most familiar phases in which 
a physical system can be, are the solid, liquid and 
gaseous phases, and the best known example for a 
phase transition is the freezing of a fluid when the 
temperature drops. In this case the temperature is 
the external or "control" parameter. 

Phase transitions are deflned by the change of one 
or more speciflc system variables, called order param- 
eters. This name, order parameter, comes from the 
observation that phase transitions usually involve an 
abrupt change in a symmetry property of the system. 
For example, in the solid state of matter, the atoms 
have a well-defined average position on the sites of an 
ordered crystal lattice, whereas positions in the liq- 
uid and gaseous phases are disordered and random. 
Accordingly, the order parameter refers to the degree 
of symmetry that characterizes a phase. Mathemat- 
ically, this value is usually zero in one phase (in the 
disordered phase) and non-zero in the other (which is 
the ordered phase). In the case of collective motion 
the most naturally (but not necessarily) chosen order 
parameter is the average normalized velocity (p, 
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Nvr, 



N 



(1) 
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where N is the total number of the units and vq is 
the average absolute velocity of the units in the sys- 
tem. If the motion is disordered, the velocities of the 
individual units point in random directions and av- 
erage out to give a small magnitude vector, whereas 
for ordered motion the velocities all add up to a vec- 
tor of absolute velocity close to Nvq (thus the order 
parameter for large N can vary from about zero to 
about 1). 

If the order parameter changes discontinuously 
during the phase transition, we talk about a first or- 
der transition. For example, water's volume changes 
like this (discontinuously) when it freezes to ice. In 
contrast, during second order (or continuous) phase 
transition the order parameter changes continuously, 
while its derivative, with respect to the control pa- 
rameter, is discontinuous. Second order phase tran- 
sitions are always accompanied by large fluctuations 
of some of the relevant quantities. 

During a phase transition a spontaneous symme- 
try breaking takes place, i.e., the symmetry of the 
system changes as we pass the critical value of the 
control parameter (e.g., temperature, pressure, etc.). 
In the case of one of the simplest representations of 
a continuous phase transition (the Ising model), the 
spins arc placed on a lattice, interact with their clos- 
est neighbors and can point up or down. For high 
temperatures the spins point in random directions 
(with a probability 1/2 either up or down), while 
for low temperatures (way below the critical point) 
most of them point in the same direction (which is 
either up or down), selected spontaneously. This is 
an example for the up and down symmetry (high 
temperatures) breaking during the transition (one of 
the directions becomes dominant). If there are in- 
finitely many possible directions (continuous symme- 
try), during a transition a single preferred direction 
can still emerge spontaneously. 

Phase transitions can occur in both equilibrium 
and non-equilibrium systems. In the context of col- 
lective motion ~ although it is a truly non-equilibrium 
phenomenon - there are reasons for the preference 
of the possible analogies with the equilibrium phase 
transitions rather than with those studied in the 
framework common in the interpretation of non- 
equilibrium phenomena. One important reason is 



that the investigations on the various universal be- 
haviors that can be associated with non-equilibrium 
systems have by now grown into a sub-discipline with 
its own language and formalism including specific 
processes the related research concentrates on. 

In particular, most of the representative reviews 
on no n-e quilibrium phase tr ansitions (see, e.g., [Odor 



j2004j or lHenkel et all 12009 ] . Non-Equilibrium Phase 
Transitions: Volume 1: Absorbing Phase Transi- 
tions) are centered on such features as i) absorbing 
states of reaction-diffusion-type systems, ii) mapping 
to the universal behavior of interface growth mod- 
els, iii) dynamical scaling in far-from-equilibrium re- 
laxation behavior and ageing, iv) extension to non- 
equilibrium systems by using directed percolation as 
the main paradigm of absorbing phase transitions. 
On the other hand, there are some specific features 
of collective motion such as giant number fluctuations 
(GNF, see below) or various unusual transitions (e.g., 
to jamming) which obviously do not occur in systems 
at equilibrium, but we still have to consider them in 
this review. On balance, we find that the language 
and the spectrum of the various aspects of equilib- 
rium phase transitions is surprisingly suitable for in- 
terpreting most of the observed phenomena in the 
context of collective motion; and this is an important 
point we intend to make. 

A further important aspect of the phenomena tak- 
ing place during collective motion is that in contrast 
with the standard assumptions of statistical mechan- 
ics, the number of units involved in the collective be- 
havior typically ranges from a few dozens to a few 
thousands (in rare cases tens of thousands). On the 
other hand, for example, phase transitions in the 
framework of statistical mechanics are truly mean- 
ingful only for very large system sizes (consisting a 
number of units approaching infinity). Quantities like 
critical exponents cannot be properly interpreted for 
flocks of even moderate sizes. However, a simple tran- 
sition from a disordered to an ordered state can take 
place even in cases when the number of units is in 
the range of a few dozens. Most of the real- life ob- 
servations and the experiments involve this so called 
"mesoscopic scale". The states (e.g. rotation) and 
the transitions (e.g., from random to ordered motion) 
we later describe can be associated with the phenom- 



2.2 DcGnitions and expressions 
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ena taking place in such mesoscopic systems. 



equation is 



2.2 Definitions and expressions 

As for the definitions used in the statistical mechan- 
ics approach, phenomena associated with a continu- 
ous phase transition are often referred to as critical 
phenomena because of their connection to a critical 
point at which the phase transition occurs. ("Criti- 
cal" , because here the system is extremely sensitive to 
small changes or perturbations.) Near to the critical 
point, the behavior of the quantities describing the 
system (e.g., pressure, density, heat capacity, etc.) 
are characterized by the so called critical exponents. 
For example the (isothermal) compressibility kt of 
a liquid substance, near to its critical point, can be 
expressed by 



Kt 



\T-Tr\ 



(2) 



where T is the temperature, Tc is the critical tem- 
perature (at which the phase transition occurs), ^ 
denotes proportionality and 7 is the critical expo- 
nent. In systems of self-propelled particles, noise 
{rf) plays the role of temperature (T): an external 
parameter that endeavors to destroy order. Corre- 
spondingly, the fluctuation of the order parameter. 



(7^ = {^P^) — ((ys)^, is described as 



|i - -nhicy 



where rj is the noise, r^c is the critical noise that sep- 
arates the ordered and disordered phases, and 7 is 
again the 'susceptibility' critical exponent. By intro- 
ducing X — cr^L^, where L is the linear size of the 
system, we get 



X ^ (7? - VcY 



(4) 



Kt in Eq. ^ corresponds to x in Eq. (g]). 

An other descriptive expressing the change in the 
density between the liquid and the gas phases, pi — pg, 
obeys to 



Pi- Pg^ {Tc - T) 



(5) 



where fi is the critical exponent. For systems of self- 
propelled particles, when L -> 00, the corresponding 



(1 - vhcf 




for rj < rjc 
for rj > Tjc 



(6) 



Regarding the relation between the order parame- 
ter If and the external bias field h ( "wind" ) , scales 
as a function of h according to the power law 



LP . 



(7) 



for rj > rjc, where 5 is the relevant critical exponent. 

Various similar expressions can be formulated in- 
volving further quantities as well as critical expo- 
nents. Interestingly, very different physical systems 
exhibiting seemingly different kind of phase transi- 
tions follow similar laws. For example the magne- 
tization M of a ferromagnetic material subject to a 
phase transition near to a critical temperature called 
Curie point, obeys M - (T^ - Tf. 

Another surprising observation is that these criti- 
cal exponents are related to each other, that is, ex- 
pressions like a + 2P + ^ — 2ov5 = 1 + ^ can be 
formulated, which hold independently of the physical 
system the critical exponents (a, /3, 7, 5) belong to. 
Note that this is a far from t rivial observa t ion! For 
more details on th is topic see IsiharaL [iQTll IPathria . 
1996 . Cardv . 1996| . and for further analogies and dif- 
ferences between ferromagnet ic models and syst ems 



(•3^ of self-propelled particles see [Czirok et al.l . 11997 



Since from a mathematical point of view, many 
of the results of statistical mechanics are exact only 
for infinitely large systems, structures are often de- 
scribed and analyzed in their "thermodynamic lim- 
its". This limit means that the number of particles 
constituting the system tends to infinity. Accord- 
ingly, finite structures do not have well defined phases 
but only in their thermodynamic limit, where the 
state-equations can develop singularities, and sharp 
phase transitions can exist between these well-defined 
phases. 

Another phenomenon accompanying phase tran- 
sitions is the formation of clusters of units behav- 
ing (e.g., being directed or moving) in the same 
way. Units which can be reached through neighboring 
units belong to the same cluster, where neighboring 
stands for a predefined proximity criterion. Thus, 
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the behavior of units in the same cluster is usually 
highly correlated. In general, correlation functions 
represent a very useful tool to characterize the level 
of order in a system. 

2.3 Correlation functions 

Generally speaking, two series of data {X and Y) 
are correlated if there is some kind of relationship 
between their elements. A correlation function mea- 
sures the similarity between the data-sequences, or, 
in the continuous case, the similarity between two sig- 
nals or functions. j4uto-correlation is the correlation 
of a signal with itself, typically as a function of time. 
This is often used to reveal repeating patterns, such 
as the presence of a periodic signal covered by noise. 
If the two signals compared are different, we consider 
cross-correlation. 

For example, let us consider two real- valued data- 
series /i and /2, which differ only by a shift in the 
element-numbers, e.g., the 5th element in the first 
series is the same than the 12th in the second, the 6th 
corresponds to the 13th, etc. In this case the shift is 
s = 7, that is, the first series has to be shifted with 
7 elements in order to be congruous with the second 
one. The corresponding (cross) correlation function 
will show a maximum at 7. Formally, for discrete 
data-sequences /i and /2, the correlation function is 
defined as: 



c(s) 



E 



/r [n] /2 [n + s] 



(8) 



where refers to the complex conjugate opera- 
tioi{3. 

Accordingly, in continuous case, when /i and /2 
are continuous functions (or "signals"), the cross- 
correlation function will reveal how much one of the 
functions must be shifted (along the horizontal axis) 
to become congruous with the other one. Formally, 



pair of complex numbers are said to be complex conju- 
gates if their real part is the same, but their imaginary parts 
are of opposite signs. For example, 2 + 3i and 2 — 3i are com- 
plex conjugates. It also follows, that the complex conjugate of 
a real number is itself. 



c(t) 



/r(i)/2(t + r)di 



(9) 



T — — OO 



Equation ^ shifts /2 along the horizontal axis 
(which is in this example the time- axis), and cal- 
culates the product at each time-step of the two 
functions. This value is maximal when /i and /2 
are congruous, because when lumps (positives areas) 
are aligned, they contribute to making the integral 
larger, and similarly, when the troughs (negative ar- 
eas) align, they also make a positive contribution to 
the expression, since the product of two negative val- 
ues is positive. 

With this introduction we can now formulate some 
specific correlation functions that are often used in 
the field of collective motion. 

The velocity-velocity correlation function, Cyy , is an 
auto-correlation function that shows how closely the 
velocity of a particle (unit, individual, etc.) at time 
t is correlated with the velocity at a reference time. 
It is defined as follows: 



1 ^ 



(10) 



where ^^(O) is the starting (reference) time and N is 
the number of particles within the system and (. . .) 
denotes taking an average over a set of starting times. 
The way c^i,(t) decays to zero shows how the veloci- 
ties at later times become independent of the initial 
ones. 

The pair correlation function, Cp (r) , (or radial dis- 
tribution function, g{r)), depicted on Fig. [21 de- 
scribes how the unit density varies as a function of 
the distance from one particular element. More pre- 
cisely, if there is a unit at the origin, and if n = N/V 
is the average number density {N is the number of 
units in a system with volume V) , then the local den- 
sity at distance r from the origin is ng{r). It can 
be interpreted as a measure of local spatial ordering. 
Equation [TT] gives the exact formula. 



Cpir) 




(11) 



2.3 Correlation functions 
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Figure 2: Radial distribution function for the so 
called Lennard- Jones model. It describes how the 
unit density varies as a function of the distance from 
one particular element in the case of an interaction 
potential having both a shorter range, a strong re- 
pulsive and a longer range attractive part. 



The directional correlation function, 
Qj(t) = {vl{t) -Vjit + r)) , 



(12) 



tells to what degree the velocity of the ith particle 
at time t is correlated with that of particle j at time 
t + T. (...) denotes averaging over time, and Vi{t) 
is the normalized velocity of the ith SPP. (Note that 
'^iji.'^) = Cji(— r).) The directional correlation de- 
lay is primarily used to determine the leader-follower 
relationship within a flock of birds, fish, or more gen- 
eral, in a swarm of self -propelled particle s (SPPs) 



as illustrated on Fig. [3] [Naev et al.l |2010| . The di 



rectional correlation delay for a pair of SPPs (i and 
J, where i,j = 1,2, . . . ,iV and N is the number of 
SPPs within the flock) is calculated according to Eq. 
1121 Then the maximum value of the Cij(r) correla- 
tion function is allocated, T*y Negative value means 
that the direction of motion of the ith SPP is falling 
behind that of the jth one, so this can be interpreted 
as j is leading. The directional correlation function 
for an SPP with respect to the rest of a given flock 
or swarm, is Ci(r) = {vi{t) ■ Vj{t + t))- j. 

Further useful correla tion functions were suggested 
in Cavagna et al.l |201Cl| in order to characterize the 



response of a flock to external perturbation. 




j = Am j=M9 j = G / = □♦ y = C^ 




Figure 3: (Color online) Illustration for the direc- 
tional correlation function, which is a tool for de- 
termining the leader-follower relationships within a 
flock or swarm. This example shows the case of a 
bird-flock, (a) Determining the projected distance 
dij (t) of birds i and j onto the direction of motion of 
the whole flock at time step t. Bird i is light gray on 
the draw, and bird j is dark. The tJJ- (t) arrows indi- 
cate the direction of bird j at each time step t. The 
center of mass of the flock is denoted with a cross, 
which moves with Vfu>ck(t), the average velocity of 
the flock. The relative position of the birds i and j is 
projected onto Vffock(t)- The directional correlation 
function for each i j pair is defined by Eq. p^ . 
(b) Scalar products vl (t) ■ ijj {t + r) of the normalized 
velocity vectors of bird i at time i, and that of bird j 
at time t + t. On this example bird j follows bird i 
with correlation time T*j . (c) The directional correla- 
tion functions Cijir) during the flock flight depicted 
on Fig. [2H1 For better transparency only five of the 
items are shown, the data belonging to birds A, M, 
G, D and C. The solid symbols indicate the maxi- 
mum value of the correlation functions, which have 
been used to determine the leader-follower network, 



depicted on[15]b. From lNaev et al.l i20ld | 
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3 OBSERVATIONS AND EXPERIMENTS 



We end this Section with a brief discussion of two 
characteristic phenomena which occur in systems of 
self-propelled particles but have no direct analogy in 
processes occurring in equilibrium. Firstly, we point 
out that in a confined geometry any group of persis- 
tently moving units having a finite size have a chance 
to be trapped or jammed. The presence of walls 
or even a too narrow "exit" would inevitably lead 
to this phenomenon (see, e.g., Kudrolli et al.l . [2OO8 . 



Helbing et ani2000t ) 



Another interesting feature is a very specific form 
of density changes called as giant number fluctua- 
tions or GNF.This expression stands for the follow- 
ing property of a system of self-propelled units: The 
fluctuation of the number of units in an increasing 
area of the system scale with the number of units (N) 
in this area linearly. In addition, these fluctuations 
relax anomalously slowly. This is in sharp contrast 
with a theoretical result valid for equilibrium systems 
according to which (along with the law of large num- 
bers) the fluctuations in the number of units grow as 
a square root o f N. This interesting feature was first 
pointed out in iNaravan et al.l 2007j for a system of 



shaken e longated rods and su bsequently commented 
upon bv lAranson et ah 2008 [ showing that inelastic 
collisions can lead to GNF even for spherical parti- 
cles. 

Since shaking introduces an average velocity and 
nematic or inelastic collisions involve a tendency for 
the particles to align, all these findings are expected 
to occur (and will be later discussed) in a variety of 
systems with collective motion. 

3 Observations and experi- 
ments 

It seems that collective motion (or flocking: these two 
notions will be used synonymously in this review al- 
though in principle there are some subtle differences 
in their meanings) is displayed by almost every living 
system consisting of at least dozens of units. H One 



■^In such small systems, we associate with "flocking" a state 
of the group in which the units assume an approximately com- 
mon direction (or orientation) developing through local com- 
munications among the entities. 



of the main points in this review is that the kinds of 
systems and the types of collective motion patterns 
have a greater variety than originally thought of. Be- 
low we give a - naturally incomplete - list of systems 
in which collective motion has been observed (with 
only some of the representative references included) : 

• Non-living systems: nematic fluids, shaken 
metallic rods , nano swimm e rs, simple r obots , 



boats, etc. iKudroUil I2OIOI llbele et all. l2009l 



Suematsu et al.l . l2010l lNaravan et al.U2007l |" 



• Macromolecules 
Butt et ail l2010( 



Schaller et al. 



2OIOI 



Bacteria colonies ICzirok et al.l. 1996 , 2001 



Sokolov et al.l . 120071 ICisneros et al.l . 12007 1 



• Amoeba iKessler and Levind . Il993l iNagano 
1998llRappel et all llQQgj 



Cell s ISzabo et al 
200' 



2006 



Friedl and Gilmoui 



Arboleda-Estudillo et al.l. 



Belmonte et al.l . 12008 1 



201c 



Insec ts Buhl et al. . 20061 . Couzin and Franks 
2003j 



Fish fHe melriik an d Kunj. I2OO5I IParrish et al 



|2002, Becco et all . .2006., Ward et all . 12008 1 



Birds iHeppnerl Il997l iBallerini et all. l2008l 
Havakawa . 2010l Baiec and HeppneiT 2009l j 



Mammals iFischhoff et al.l. 12007 

Sueur and PetH l2008l iKing et all l2008l | 



Hurnans iFaria et al.l. 2010b, Helbing et al 
l200d " 



19971 bOOdTMoussaM et all I2OII 



Although throughout the present review we pri- 
marily classified the observations and experiments 
based on the organizational complexity of the units 
constituting the systems, there are various other as- 
pects as well, by which valid and meaningful catego- 
rizations can be made, such as: 

• The patterns the units form (coherently moving 
clusters, mills, stripes, etc) 

• From an energetic viewpoint: 



3.1 Data collection techniques 
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— The way it is introduced to the system (uni- 
formly, at the boundaries, at special points, 
etc.) 

— if the particles can preserve it (animals) 
or they dissipate it almost immediately 
(shaken rods) 

• The way the units interact with each other. This 
can be 

— physical, chemical (chemotaxis), visual or 
medium-mediated 

— isotropic or anisotropic 

— polar or apolar 

— short or long-range (regarding its temporal 
characteristics) 

— through metric or topological distance 

3.1 Data collection techniques 

The main challenge during the implementation of ob- 
servations and/or experiments on collective motion, 
is to keep a record on the individual trajectories of 
the group- members. This can easily turn out to be a 
difficult task, since (i) most of the colonies or groups 
being investigated consist of many members which 
(ii) usually look very much alike (iii) and are often 
moving fast - just think of a flock of starlings. The 
applied technology is chosen by considering two fac- 
tors: (i) the size of the moving units, and (ii) the size 
and dimension of the space in which the group can 
move. Both parameters range through many scales: 
bacteria and cells are subjects of such experiments as 
well as African buffalos or whales. Also, the area in 
which the ob servation is carri e d out can range from 
a Petri dish Keller and Seee 1, Il97l| to the Geor ges 
Bank (a region se parating the Gulf of Maine from the 



Atlantic Ocean, Makris et al. . 2009| ). Accordingly, 



there is a variety of technologies that have been ap- 
plied during the last decades. 

The method called "Par ticle Image Velocimetry" , 



(PIV) [Raffel et all . l2002{ is used to visualize the 



motion of small particles moving in a well-confined 
area. Originally it is an optical technique used to pro- 
duce the two dimensional instantaneous velocity vec- 
tor field of fluids, by seeding the media with 'tracer 



particles'. These particles are assumed to follow 
the flow dynamics accurately, and it is their motion 
that is then used to calculate velocity information. 
ICisneros et al.l 2007 1 applied this method in order to 
evaluate the velocity flled of thousands of swimming 
bacteria. The task of tracing cells share many similar- 
ities w ith the challenge of tracing the motion of bac- 
teria. Czirok et al. 1998l | used computer controlled 
phase contrast video microscope system in order to 
follow the collective motion of cells. The trajecto- 
ries were recorded for several days to determine the 
velocities of each cell of the types. 

The movement of vertebrate flocks has been 
tracked mainly by camera-based techniques. Here, 
the observed animals are bigger, but the space in 
which they move is often unconfined. The simpler 
case is when the group to be o bserved moves only 
in two dimensions. In the '70-es lSinclaiii 1977| used 
aerial photos to investigate the individual's spatial 
positions within grazing African buffalo herds. Ex- 
actly because of the difficu lties of analyzing three 
dimensional group motions, Becco et al.l 2006} con- 
fined the motion of fish to two dimensions by putting 
them into a container which was "basically" two di- 
mensional (in the sense that it was very shallow): 
40cTO X 30cTO X 2cm. This arrangement was con- 
venient to track fish with a single video recorder. A 
homogeneous light source was placed above the con- 
tainer and a CCD camera recorded the fish from be- 
low. (Obviously, the usage of the container confined 
the area of motion as well.) 

In order to reconstruct the thr ee-dimensional posr 



tions and orientations of the fish. lCullen et al.l [1965 1 



used th e so called "shadow me thod" . With this tech- 
nology. Partridge et al. 1980l | investigated position- 
ing behavior in fish group s of up to 30 individuals. 



Parrish and TurchinI jl997l | recorded the trajectories 



of fish in three dimensions with three orthogonally 
p ositioned video camera s. 

Major and Dill.! [l978] were the first to apply the 



stereo photography technique in order to record the 
three dimensional positions of birds within flocks 
of European starlings and dunlins. By usi ng the 
same technique, recentlv lBallerini et al. 2008 1 recon- 
structed the three-dimensional positions of hundreds 
of starlings in airborne flocks with high precision. 
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3 OBSERVATIONS AND EXPERIMENTS 



The stereo photography method allowed the detailed 
and accurate analysis of nearest neighbor distances 
in large flocks, but still did not make the trajectory 
reconstruction of the individual flock members possi- 
ble. 

As technology advances, newer and newer methods 
and ideas show up with the purpose of studying col- 
lective motion. Here we mention two of these: The re- 
cently developed OWARIS ( "Acoustic Waveguide Re- 
mote Sensing") exploits the wa ve propagation prop - 



erties of the ocean environment Makris et al. , 2006| , 



and makes the instantaneous imaging and continu- 
ous monitoring of fish populations possible, covering 
thousands of square kilometers, that is, an area tens 
of thousands to millions of times greater than that 
of conventional methods. The other new method is 
based on the usage of the "Global Positioning Sys- 
tem", commonly known as GPS. The idea is to put 
small GPS devices on moving animals by which the 
problem of trajectory-recording is basically solved. 
With this method the trajectory of flock members 
can be collected with high temporal resolution in 
their natural environment. The limits of this tech- 
nique at this moment are on the one hand the grow- 
ing cost of the research with the growing number of 
tracked flock members, and on th e other hand the 
limi ted accuracy of th e devices. iBiro et ah 
and iNagy et all |20ld| analyzed GPS logged flight 
tracks of homing pigeon pairs in order to investigate 
hierarchical leadership re lations inside the group and 



DeU'Ariccia et al.l |2008l | used this method to study 
the homing efficiency of a pigeon group consist of 6 
birds. 



3.2 Physical, chemical and biomolec- 
ular systems 

Along with the accumulating observations and exper- 
iments clarified the recognition, that flocking - collec- 
tive motion - emerges not only in systems consisting 
of living beings, but also among interacting physical 
objects, based on mere physical interactions without 
communic ation. A very sim ple system has been de- 
scribed bv llbele et all |2009| who reported about sim- 
ple autonomous micromotors, which are micrometer- 
sized silver chloride (AgCl) particles exhibiting col- 



lective motion in deionized water under UV illumi- 
nation. The autonomous motion these particles ex- 
hibit under the above circumstances (deionized wa- 
ter and UV light) is due to their asymmetric photo- 
decomposition, and the spatial self-organization is 
due to the ions which are secreted by the AgCl par- 
ticles as they move. 

Various experiments on non-living self propelled 
particles (SPPs) possessing diverse features advo- 
cate that the shape and symmetry of the SPPs 
play an important role in their collective dynam- 
ics, and that large-scale inhomogeneity and coher- 
ent motion can appear in a system in which parti- 
cles do not communicate except by contact. Sym- 
metric (or "apolar" ) rods on vibrating surfaces have 
been observed to form nematic order and under cer- 
tain con ditions found to exhibit persistent swirlin g 
as well Naravan et al. , l2006l iGalanis et al.l , l2006l| . 



van et i 

Naravan et alljioOTj have also investigated symmet- 
ric macroscopic rods and have found giant number 
fluctuations lasting long, decaying only as a logarith- 
mic function of time (see Fig. 0. This finding is 
in obtrusive contrast with the expected behaviour, 
since the the central limit theorem predicts number 
fluctuations proportional to the square root of the 
particle number, in the homogeneous ordered phase 
of equilibrium systems, away from the transition. By 
conducting c omplementary exper iments with spheri- 
cal particles, |Arai]Son_et_alJ 2008{ demonstrated that 
the giant number fluctuation phenomenon can arise 
either from dynamic inelastic clustering or from per- 
sistent density inhomogenity as well. 

Periodically, v ertically vibrated granular rods form 
vortex patterns Blair et al.l , |2Q03| ] . Above a critical 
packing fraction, the ordered domains - consisting of 
nearly vertical rods - spontaneously form and coex- 
ist with horizontal rods (see Fig. |4]). The vortices 
nucleate and grow as a function of time. Exper- 
iments performed in an annulus with a single row 
of rods revealed that the rod motion was generated 
when these objects were inclined from the vertical, 
and was always in the direction of the inclination (see 
Fig. [5]). The relationship between the covered area 
fraction and the diffusion propertie s in the case o f 
se lf-propelled rods was also studied Kudrolli . 20ld |. 
KudroUi et al. 2008l | have made experiments with 
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Figure 4: Periodically, vertically vibrated granular 
rods spont aneously form vor tices which grow with 



2003j 



1 V 



Figure 5: Experiments performed in an annulus with 
a single row of rods reveal that the rod motion is 
generated when these objects are inclined from the 
vertical, an d is always i n the direction of the inclina- 
tion. From lBlair et all |2003| 



polar (non-symmetric) rods on a vibrating surface. 
Their rods had a symmetric shape, but a non- 
symmetrical mass distribution which caused them to 
move toward their lighter end. They have observed 
local ordering, aggregation at the side walls, and clus- 
tering behavior. Apolar, but roun d-shaped disks have 
also been studied Deseigne et al.l . [2010.] . By shaking 
a monolayer of these small objects with variable am- 
plitude, large-scale collective motion and giant num- 
ber fluctuations could be observed. 

Another experiment studying inanimate objects 
used radio-controlled boats moving in an annular 
pool, interac t ing t hrough inelastic collisions only 



Tarcai et al.l . 1201 ij . The team recorded various 




Figure 6: A snapshot of the nematic order assumed 
by 2820 rods which are sinusoidally vibrated perpen- 
dicularly to the plane of the image. The large density 
fluctuations take several minutes to rel ax and to form 
elsewhere. From iNaravan et al.l 2007 1. 



ordered and ordered motion, depending on the noise 
level. They also found that a few steerable boats - 
acting as leaders - were able to determine the di- 
rection of the group. For this end, it was enough 
to manipulate 5 — 10 % of the boats. In a some- 
what similar experiments, the collective motion of 
camphor boats were studied, interacting through the 
chemical field, swimming in an annular water chan- 
nel. Here too, several patterns were observed, such as 
homogeneous state, clu ster flow and congestion flow 



Suematsu et al. , 2010| . 



Tinslev et all |2008| presented 



an 



experimen- 
tal study on interacting particle-like waves (see 
more about t he de sign of wave propagation in 
Sakurai et al. 2002l |) and suggested this method 



as an opportunity to investigate small groups of 
SPPs in laboratory environment. The stabilized 
wave-segments they have used were those appearing 
in the light-sensitive Bel o usov-Z habotinsky reaction 



Zaikin and Zhabotinskv . 1970l |. These constant 



kinds of patterns, such as jamming, clustering, dis- 



velocity chemical waves can be interpreted as self- 
propelled particles which are linked to each other via 
appropriate interaction potentials. 

Along with the accumulation of the experimental 
results, the assumption that only a few parameters 
and factors play a crucial role in the emergence of 
the ubiquitous phenomena of collective motion has 
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3 OBSERVATIONS AND EXPERIMENTS 



fluorescentty labeled F-actin 



unlabeled F-a^tir* 





Figure 7: (Color online) The setup of the experiment 
designed to investigate the effect of density on the 
collective motion of actin filaments, (a) Filament- 
motion is visualized by the usage of fluorescently la- 
beled reporter filaments. The ratio of labeled to unla- 
beled molecules is around 1:200. (b) For low filament 
densities a disordered structure is found, where the 
bio-molecules perform persistent random walk with- 
out directi onal preference. Sc ale bar represents 50 



From lSchaller et all |2010| 



been increasingly supported. Particle-density turns 
out to be one of these parameters, or more precisely, 
the density of the objects or living beings that exhibit 
collective motion. 

The essential role of the density has been demon- 
strated in a set of elegant experiments on persis- 
tently moving biomolecules. In these investigations 
- involving the smallest, experimentally realized self- 
propelled particles so far - the so called in vitro motil- 
ity assay is utilized to study the emergence of collec- 
tive motion on a molecular level. In such an assay 
actin filaments and fluorescently labeled reporter fil- 
aments are propelled by immobilized molecular mo- 
tors (myosin molecules) attached to a pla nar surface 
as dep icted on Fig. [T] In a recent study, iButt et al 



lep: 

2010l | were the first to observe the bulk alignment 



of the actin filaments sliding movement for high con- 
centration values even though they were powered by 




Figure 8: (Color online) Motion of actin filaments 
in a motility assay, (a) The individual filaments 
were tracked automatically and the positions (de- 
noted by circles) were used to estimate their (color 
coded) direction of motion, (b) The color coded (as 
above) paths plotted as a continuous track to high- 
light the trajectory of each filament. The tracks 
shown are from a 100-frame vi deo sequence reco rded 



at 25 frames/s. Adapted from Butt et al. 2010l |. 



randomly oriented myosin molecules (Fig. [5]). Ac- 
cording to their observations, domains of oriented fil- 
aments formed spontaneously and were separated by 
distinct boundaries. The authors suggested that the 
self-alignment of actin filaments might make an im- 
portant contribution to cell polarity and provide a 
mechanism by which cell migration direction might 
respond to chemical cues. At almost the same time, 
Schaller et afl |2010l | undertook a very similar study, 
but in a somewhat different context of active mat- 
ter and using extensive evaluation and computational 
techniques to characterize the phenomenon. They 
also found that the onset of collective motion was 
a result of increased filament density. In particu- 
lar, for low filament densities a disordered phase has 
been discerned, in which individual filaments per- 
formed random walk without any directional pref- 
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Figure 9: (Color online) The typical behavior of the 
bio-molecule actin filament in the function of den- 
sity. The disordered structure (a) becomes ordered 

(b) above a certain density p*, which is around 0.8 
filaments per p,m^. In this high density regime, wave- 
like structures can be observed. Above 0.2 filaments 
per /im^, spirals or swirls can be observed as well 

(c) , which are characterized by huge angular velocity 
gradients destabilizing the swirl. This limited stabil- 
ity is visible near to the central region of the pat- 
tern, where crushing events of the filament current 
are l ikely to develop. Sca le bar is 50 iim. Adapted 
from lSchaller et all |2010j . 



erence. Above a certain density, which was around 
0.2 filaments per firri^, in an intermediate regime, 
the disordered phase became unstable and small clus- 
ters of coherently moving filaments emerged. Further 
concentration-increase caused growth in the cluster- 
sizes, but the bunches remained homogeneous. Then, 
above 0.8 filaments per /im^ (signed with p* on Fig. 
[9]), persistent density fluctuations occurred, leading 
to the formation of wave-like structures. The au- 
thors also identified the weak and local alignment- 
interactions to be essential for the formation of the 
patterns and their dynamics. A simulation model 
was used to interpret the interplay between the un- 
derlying microscopic dynamics and the emergence of 
global patterns in a good agreement with the obser- 
vations. 

The collective behavior and pattern formation 
in granular, biological, a nd soft matter sys- 
tems have been reviewed by lAranson and Tsimrine 
20061. and more recently i n their book as well. 



Aranson and Tsimring , |2009| , including both exper- 



3.3 Bacterial colonies 

Since microorganism colonies (such as bacteria 
colonies) are one of the simplest systems consist- 
ing of many interacting organisms, yet exhibiting a 
non-trivial macroscopic behavior, a number of stud- 
ies have focused on the experimental and theoretical 
aspects of col ony formation and on the related collec- 
tive behavior Shapiro and Dworkinl . ll997llAlt et al.L 
1997llVicsekl . l2001aj . 



The first in vestigations date back to the early 
1970-es, when Keller and Segell |197l| studied the 
motion of Escherichia coli bands and developed 
a corresponding phenomenological theory as well. 
They used partial differential equations describ- 
ing the consumption of the substrate and the 
change in bacterial density due to random mo- 
tion and to chemotaxis. Since than, many ob- 



servations have been made Childress et al 



Fujikawa and Matsushita . 19891 IVicsek et aU 



1975 



1990 



Ben- Jacob et al.l . 1994j . and it has become evident 



that the bacteria within the colonies growing on wet 
agar surfaces produce an exciting variety of collec- 
tive motion patterns: among others, motions sim- 
ilar to super-diffusing particles, highly correlated 
turbulent as well as rotating states have been ob- 
served, and colony formations exhibiting various pat- 
terns including those reminiscent of fractals. A spe- 
cial category are those studies which contain not 
only an observation or a theoretical model, but 
a matching pair of them: detailed description of 
an observation together with a computational or 
mathematical model that accounts for the obser- 



1 r- 



vations [Keller and Scgcl, 1971, Czirok e t al.l . 11996 . 
Wu et al., 2009, 2007 , Czirok ct al.. . 2001] . 

Czirok et al.l (l996l | were the first to interpret an 



iments and theoretical concepts. 



experimentally observed complex behavior through a 
many-particle-type simulation, incorporating realis- 
tic rules. They have investigated the intricate colony 
formation and collective motion (formation of rotat- 
ing dense aggregates, migration of bacteria in clus- 
ters, etc.) of a morphotype of Bacillus subtilis using 
control parameters, such as the concentration of agar 
and peptone, which was the source of nutrient. Under 
standard (favorable) conditions bacterium colonies 
do not exhibit a high level of organization. How- 
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Figure 10: (Color online) A typical colony of the vor- 
tex morphotype of Bacillus subtilis. The black discs 
contain thousands of bacteria circling together as the 
discs themselves glide outward on the surface during 
colony growth. Courtesy of E. Ben- Jacob. 




Figure 11: Swimming Bacillus subtilis cells exhibit- 
ing collective dynamics. On a large scale, response to 
chemical gradients (oxygen, in this case) can initiate 
behavior th at results in striking hydrodynamic flows. 
From iCisneros et al. 



ever, under certain hostile environmental conditions 
(like limited nutrient source or hard agar surface) the 
complexity of the colony as a whole increases, charac- 
terized by the appearance of cell- diff erentiation and 
long-range information transmission |Shapirol . ll988| . 
For describing the observed hydrodynamics (vortex- 
formation, migration of clusters) of the b acteria in 



an intermediate level, Czirok et al.l |l996j proposed 



a simpler model of self-propelled particles, and more 
complex ones - taking into account further biologi- 
cal details - to capture the more elaborated collective 
behaviors, like the vortex and colony formation (see 
Sec. I5.1.3|) . Figure ITOl depicts a typical bacterium 
colony formed by the vortex morphotype. 

This kind of bacterium. Bacillus subtilis, when 
the cells are very concentrated (nearly close-packed) , 
forms a special kind of col lective phase called " Zoom- 
ing BioNematics" (ZBN) [Cisneros et"alll2007| . This 
phase is characterized by large scale orientational co- 
herence, analogous to the molecular alignment of ne- 
matic liquid crystals, in which the cells assemble to- 
gether into co-directionally swimming clusters, which 
often move at speeds larger then the average speed 
of single bacteria. Figure [TT] shows a snapshot of 
swimming Bacillus subtilis cells exhibiting collective 
dynamics, and Fig. I12l depicts the corresponding vor- 



ticity field. By simultaneously measuring the posi- 
tions, velocitie s and orientations of around one thou- 
sand bacteria, Zhang et al.l 20101] demonstrated that 
under specific conditions, colonies of wild-type Bacil- 
lus subtilis exhibit giant number fiuctuations. More 
specifically, they found that the number of bacteria 
per unit area shows fluctuations far larger than those 
for populations in thermal equilibrium. 

The collective behavior of motile aerobic bacte- 
ria ("aerobic" are those bacteria which need the 
presence of oxygen for their survival), primarily in 
high cell-concentration, is governed by the inter- 
play between buoyancy, oxygen consumption, mix- 
ing and hydrodynamic interactions. The pattern- 
formation of these bacteria is often governed by an- 
other physical mechanism as w ell, called hioconvec- 



tion jPedlev and Kessleii |1992|, which appears on 
fluid medium having a surface open to the air. The 
authors argued that the patterns appear because bac- 
teria, which are denser than the fluid they swim 
in, gather at the surface creating a heavy layer on 
the top of a lighter medium. When the density of 
the bacteria-cells exceed a certain threshold, this ar- 
rangement becomes unstable resulting in a large-scale 
ce ll circulation (or con vection) . 

Sokolovet"all(2009f have investigated the onset of 
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Figure 12: (Color) A snapshot of the vorticity field of 
the swimming bacteria Bacillus subtilis (depicted on 
Fig. [TT]). The small arrows indicate the correspond- 
ing velocity field. The color bar indicates vorticity in 
seconds~^ . The turbulent motion of the suspension 
is well-observable. The regions of aligned motility are 
hundreds of times larger than the size of the bacteria, 
remaining co herent for the order o f magnitude of a 
second. From Icisneros et aD l2007t. 



large-scale collective motion of aerobic bacteria swim- 
ming in a thin fluid, a 'film', which had adjustable 
thickness. They have demonstrated the existence of 
a clear transition between a quasi-two-dimensional 
collective motion state and a three-dimensional tur- 
bulent state that occurs at a certain fluid-thickness. 
In the turbulent state - which is qualitatively differ- 
ent from bioconvection - an enhanced diffusivity of 
bacteria and oxygen can be observed, which - suppos- 
edly - serves the better survival of bacteria colonies 
under harsh conditions. 

In another remarkable recent paper, while seeking 
to understand how cert ain bacter i a colo nies are able 
to spread so efficiently, Wu et al. 2009l | reported on 



a completely unexpected phenomenon: they found 
that members of a certain kind of bacteria (Myxococ- 
cus xanthus) regularly reverse their direction, head- 
ing back to the colony which they have just came 
from, which is - seemingly - only a waste of time 
and energy. Motivated by these observations, the 




single cell 

slime trail 
mound 

raft 



Figure 13: The edge of the expanding colony of bacte- 
ria M. xanthus. Some individual cells and slime traits 
are labeled, along with some multicellular "rafts" and 
mounds. The colony is expanding in the radial di- 
rection, which is to the right in this image. From 
Wu et all |2009l |. 



authors constructed a detailed computational model 
that took into account both the behavior and the cell 
biology of the bacteria M. xanthus. The most in- 
teresting result was revealed by the model, namely, 
that these reversals generate a more orderly swarm 
with more cells oriented in parallel, making the cells 
less likely to collide with each other. Without these 
turn-backs the cells would become disordered and as 
a whole, would move at a slower rate while finally 
coming to a standstill. The model predicts that the 
swarm expands at the greatest rate when cells reverse 
their direction approximately every eight minutes - 
which is in exact match with the observations. Fig- 
ure [13] shows a snapshot of the expanding colony of 
bacteria M. xanthus. 

Wild-type ( "normal" ) Myxococcus xanthus has two 
different kinds of engines to move itself: a pilus at 
its front end which pulls the cell, and a slime se- 
cretion e ngine at its rear that pushes the bacterium 
forward. IWu et al.l |2007l | have investigated the coor- 
dinated motion and social interactions of this bacteria 
by using mutants: bacteria that were void of either 
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described in detail - a model has been developed as 
well, which is in excellent agreem ent with the ob- 



Figure 14: The colony of Bacillus subtilis which - 
similarly to P. mirabilis - grow in a peculiar concen- 
tric ring-like pattern, which is the result of a sp ecial 



swarming cycle report ed by ICzirok et al 




Yamazaki et al. 



one or the other type of engine. Based on their ob- 
servations they have introduced a cell-based model 
to study the role of the two different kinds of engines 
and to show how the interactions between neighbor- 
in g cells facilitate swa rming . 



ICzirok et alJ 12001 



reported on swarming cycles 
(exhibited by many bacterial species) resulting in 
a colony with concentric rings (see Fig. [Til) . (Al- 
though the phenomenon had been known for some 
time, in their study both the quantitative measure- 
ments and the theoretical interpretation have been 
the subject of research.) These zones develop as 
the bacteria [Proteus mirabilis in their experiments) 
multiply and swarm following a periodically repeat- 
ing scenario: when the bacteria cells are applied to 
the surface of a suitable hard agar medium, they 
grow as short, immotile "vegetative" rods. Then, 
after a certain time, cells start to differentiate at 
the colony margin into long motile "swarmer" cells 
which then migrate rapidly away from the colony un- 
til they stop and revert by a series of cell fissions 
into the vegetative cell form again. These cells then 
grow normally for a time, until the swarmer cell dif- 
ferentiation is initiated in the outermost zone again, 
and the process continues in periodic cycles result- 
ing into the concentric ring-structure. For this pro- 
cess - every step of which has been observed and 



servations. lYamazaki et al.l |2005l | investigated the 
above described periodic change between the motile 
and the immotile cell states experimentally, and con- 
cluded that the change between the two states was 
determined neither by biological nor by chemical fac- 
tors, but by the local cell density. 

Many papers deal with the effects of cell-density 
on the collective behav ior of a bacterium colony. 



Dombrowski et al.l j2004| artificially created regions 



in which a given type of bacteria-cells are strongly 
concentrated. In these regions the authors found 
striking collective effects with transient, reconstitut- 
ing, high-speed jets straddled by vortexes, and sug- 
gested a corresponding modification for the Keller- 
Segel model which takes into account the hydrody- 
namic interactions as well. (The Keller-Segel model 
is probably the most prevalent model for chemical 
control of cell movements, which has b een originally 
introduced by iKeller and Segel |l97l| .'l The rele- 
va nce of the hydrodyn amic effects was highlighted 
bv ISokolov et ^ [20071 as well, who presented ex- 
perimental results on collective bacterial swimming 
in thin, two-dimensional fluid films by introducing 
a novel technique that made it possible to keep 
bacterium-cells in condensed populations exhibiting 
a djustable concentra tion. 

Zhang et"all|2009| related the characteristic veloc- 



ity, time and length scales of the collective motion of 
a given type of swarming bacteria colonies. 

The effects of the biomechanical interactions (aris- 
ing from the growth and division of the bacteria cells) 
on the colony formation ~ although bei ng ubiquitous 



have received little attention so far. Volfson et al.l 



|2008l | addressed this issue by observing and sim- 
ulating the structure and dynamics of a growing 
two-dimensional colony of non-motile bacteria, Es- 
cherichia coli. They found that growth and division 
in a dense colony led to a dynamic transition from 
a disordered phase to a highly ordered one, charac- 
terized by orientational alignment of the rod-shaped 
cells (see Fig. 1X5]) . The authors highlighted, that this 
mechanism differed fundamentally from the one ar- 
ranging the particles of liquid crystals, polymers or 
vibrated rods, since this latter one was due to the 
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combination of fluctuation and steric exclusion. 

Further studies also suggest that the local align- 
ment among Escherichia coli cells is accomplished 
by cell body collisi ons and /or short-ran ge hydrody- 
namic interactions Darnton et al. . 2010l ]. According 
to this experiment the directional correlation among 
the cells is anisotropic, and the speeds and the orien- 
tations are correlated over a short, several cell-length 
scale. The orientations of the bacteria were continu- 
ally, randomly modified due to jostling by neighbors. 
Cells at the edge of the swarm were often observed 
to pause and swim back towards the swarm or along 
its edge. 



In a recent paper iDrescher et al.l [201l| also chal 



lenge the models that explain the motion of these 
bacteria based on long-range hydrodynamic effects. 
They argue that noise, due to intrinsic swimming 
stochasticity and orientational Brownian motion ba- 
sically eliminates the hydrodynamic effects between 
two bacteria beyond a few microns, that is, short- 
range forces and noise dominate the interactions be- 
tween swimming bacteria. 

The web-page maintained by the Weibel lab, 
http : //www. biochem. wise . edu/f aculty/weibel/ 
lab/gallery/movies . aspx contains movies of 
several types of swarming bacteria, among others, 
Escherichia coli. 



Tokita et al.l |2009| studied the morphological di- 



versity of the colonies of the same type of bacteria, 
Escherichia coli, as a function of the agar and nu- 
trient concentration. Various colony shapes were ob- 
served, classified into four fundamental types based 
o n the main characte r istics of the patterns. 

Wu and Libchaber 200d | investigated a new situ- 
ation, involving two types, active and passive par- 
ticles moving in a fiuid. The active particles were 
Escherichia coli bacteria, and the passive units were 
micron-scale beads. The aim was to study the ef- 
fects of bacterial motion on inactive particles on a 
quasi-two-dimensional geometry. They found large 
positional fluctuations for beads as large as lO/zm in 
diameter and measured mean-square displacements 
indicating superdiffusion in short times and normal 
diffusion in long times. 

Here we would like to note that 
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Figure 15: (Color online) The growth and ordering 
of the bacteria E. coli in a quasi 2D open microflu- 
idic cavity. Originally, at the beginning of the test, 
the cells are distributed evenly and sparsely. The 
three snapshots are taken at (a) 60, (b) 90, and (c) 
138 minutes from the beginning of the experiment, 
respectively. Growth and division in a dense colony 
leads to a dynamic transition from a disordered phase 
to a highly ordered one, characterized by orienta- 
tiona l alignment of the rod-shaped cells. Adapted 
from lVolfson et all |2008| . 



Copeland and Weibell |2009| published a very 
useful review on bacterial swarming from a biological 
point of view. 

3.4 Cells 

The basic observations and experiments regarding 
unicellular organisms (also, cells) have been dis- 
cussed in the previous section (13. 3|) since many kinds 
of bacteria-stems proved to be good subject for var- 
ious experiments. However, some interesting exper- 
iments regarding the collective motion of unicellular 
beings, have not been made on bacteria, but other 
kind of cells. 

Here we only shortly mention some studies investi- 
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gating the collective motion of the cells Dictyostelium 
discoideum (commonly referred to as slime mold). 
In order to describ e the dynamics of these cells, 
Rappel et al.l 1999l | took into account their shape 
and plasticity. Based on the observations regard- 
ing how these amoeba cells aggregate into rotat- 
ing "pancake" -form structures, the authors built a 
model of the dynamics of self-propelled deformable 
objects (see also in Sec. I5.1.2|) . According to 
the experiments, these cells tended to form round 
structures which rotated around the center clock- 
wise or counterclockwise (depending on some ini- 
tial conditions) often persisting for tens of hours. 
Using the same ge nus, Dictyostelium discoideum, 
McCann et"al] |2010l| conducted experiments in order 
to elucidate the role of signal relay - a process during 
which the individual cells amplify chemotactic signals 
by secreting additional attractants upon stimulation 
- in the collective motion of these cells. They found 
that this process enhances the recruitment range, but 
does not effect the speed or directionality of the cells. 

Next we discuss the collective motion of cells in 
highly structured, multi- cellular organisms, in which 
cell migration plays a major role in both embry- 
onic development (e.g. gastrulation, neural crest 
migration) and the normal physiological or patho- 
physiological responses of adults (e.g. wound heal- 
ing, immune response or cancer metastasis). In these 
mechanisms cells have to be both motile and adhere 

to one othe r. In order to describe these features, 

ISzabo et al.l |2010l | expanded the cellular Potts model 
by including active cell motility, and studied a cor- 
responding computer simulations as well, which was 
compatible with the experimental findings. 

In living organisms different strategies exist for 
cell movement, including both individual cell mi- 
grati qn and the co ordinated movement of groups of 
cells jRorthl . 12007} . Figure [H] summarizes the basic 
types of collective cell migrations with respect to the 
strength of the contact among the cells moving to- 
gether. 

i) Groups can be associated loosely with occasional 
contact and much of the apparent cohesion might 
come from essentially solitary cells following the same 
tracks and cues. Examples are germ cells in many 
organisms; the rostral migratory stream supplying 



neurons to the olfactory bulb (RMS) and neural crest 
(NC) cells migrating from the developing neural tube 
to many distant locations in the embryos of mam- 
mals; sperm cells. Although the collective motion 
of these cells are often guided by chemical signals, in 
some cases they can al so form patte r ns ba sed on mere 
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hydrodynamic effects [Riedel et al.l 

ii) Other migrating groups are more tightly asso- 
ciated and the cells normally never dissociate. Ex- 
amples are the fish lateral line, structures perform- 
ing branching and sprouting morphogenesis such as 
trachea or the vasculature and finally moving sheets 
of cells in morphogenesis or wound healing. These 
groups have an additional feature, in that the mov- 
ing structure has an inherent polarity, a free 'front' 
and an attached 'back'. 

iii) Drosophila border cells are a group or clus- 
ter of cells performing a directional movement dur- 
ing oogenesis. These migrating cells are associ- 
ated tightly but the cluster is free, without an in- 
herent 'back'. A particularly nice visualization of 
the collectively moving cells during the develop- 
ment of zebra fish (by three dimensional tracing 
of live-stained cell nuclei) very well demonstrates 
the rele vance of collec tiv e motion durin g morp ho- 
genesis Schoetz . l2008j |. iLecaudev et al.l |2008l | in- 



vestigate the mechanism that organize cells behind 
the leading edge. In particular, they study the 
role of the fibroblast growth factors (Fgfs) - a sig- 
naling method known t o regulate many types of 
developmental processes 



Affolter and Weiieil . I2005L 



Ciruna and Rossantl . |2001| - during the formation of 
sensory organs in zebrafish. The role of chemokine 
signaling in regulating the self-organizing migration 
of tissues duri ng the morphogenesis of zebrafish is 
investigated bv lHaas and Gilmour 2006{ . 

By using an interdisciplinary approach, 
Diz Munoz et al.l |2010{ identified MCA (membrane- 
to-cortex attachement) as a key component in 
controlling directed cell migration during zebrafish 
gastrulation. They showed that reducing MCA in 
mesendoderm progenitor cells during gastrulation 
reduces the directionality of the cell migration as 
well. By inv estigating the same proc e ss, ze brafish 



gastrulation, Arboleda-Estudillo et al. 2010| found 



that individually moving mesendoderm cells are 
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capable of normal directed migration on their own, 
but for moving coherently, that is, for participating 
in coordinated and directed migration as part of a 
group, cell-cell adhesion is required. 

In order to distinguish individual, cell-autonomous 
displacements from convective displacements caused 
by large-scale m orphogenetic tissue movements 



Zamir et alJ |2006l | have developed a technique. Us- 
ing this methodology, they have separated the active 
and passive components of cell displacement directly, 
during th e gastrulatio n proc ess in a warm-blooded 



embryo. Czirok et al. (2008j provided an excellent 
review on cell-movements and tissue-formation dur- 
ing vasculogenesis in warm-blooded vertebrates. As 
the key mechanism for this process, the authors iden- 
tified the formation and rapid expansion of multicel- 
lular sprouts, by which the originally disconnected 
endothelial cell clusters join and form an intercon- 
nected network. 

A quantitative analysis of the experimentally ob- 
tained collective motion and the associated ordering 
transiti on of co-moving fis h keratocites was carried 



out by ISzabo et al.l |2006{ . They have determined 



the phase transition as a function of the cell density 
(Fig. lisp and, motivated by their experimental re- 
sults, have constructed the corresponding model as 
well (see Sec. 15.1.21) . Figure [T71 shows the typical col- 
lective behavior of the keratocite cells for three differ- 
ent densities, and Fig. [T8]depicts the phase transition 
(described by the order parameter) as a function of 
the normalized cell density. Other aspects of collec- 
tive cell motion - for example the relation between 
the viscosity of the subst rate and the velocity of the 
cells - were also studied Murrell et al.l . 12011 1 . 



Further interesting examples for the collective mo- 
tion of tissue cells are related to the following two 
processes: 

Tissue repair and wound healing. In tissue repair, 
collective migration is seen in vascular sprouts pen- 
etrating the wound or the horizontal migration of 
epithelial cell-sheets across 2d substrates upon self- 
renewal ofkeratinocytes migrating across the wound 



Fried! |200J|. In epithelial tissue, the opening of a 
gap induces the proliferation and movement of the 
surro unding intact cells, w hich eventually closes the 
gap. Kornvei et al. 2000l | studied the responses of 
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Figure 16: (Color online) The basic types of collec- 
tive cell migrations with respect to the strength of 
the contact among the cells moving together. The 
schematic drawing of the cells are white with gray 
circles within them, which are the nuclei. The dark 
lines on (a) and (c) are migration-permissive tracks in 
the substrate. The movement is from left to right, (a) 
and (b) depict loosely associated cells which contact 
rarely (a), or more frequently, (b). Although these 
kind of motions are sometimes restricted by tracks, 
the cells mostly contact the substrate with a high 
degree of freedom. Neural-crest cells and germ-line 
cells belong to these categories. The cell-structure 
depicted in (c) has a well-defined front and back part. 
An example is the neuromast cells of the fish lateral 
line, (d) shows an example of tracheal or vascular- 
type branch outgrowth, during which the cells remain 
associated through the the central bud growing out 
from the existing epithelium cells, (e) shows an ep- 
ithelial sheet moving to close a gap. These cells most 
probably have only a small degree of freedom, (f) 
A border-cell-cluster moves among giant nurse cells 
which are de picted by the surrounding squares. From 



RorthI [2007| 



artificially mechanically injured astrocytes (a charac- 
teristic star-shaped glial cell in the central nervous 
system) in vitro. In particular, the changes in the 
cell-motility, proliferation and morphology were an- 
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Figure 17: Phase contrast images showing the col- 
lective behavior of fish keratocites for three diiTer- 
ent densities. The normalized density, p is defined 
as p = p/pmaxi where Pmax is the maximal ob- 
served density, 25 cells/100 x 100/xm^. (a) p = 1.8 
cells/100 X corresponding to p = 0.072 (b) 

p = 5.3 cells/100 X lOO^rn^ ^j^jj^j^ jg ^ ^ o.212, and 
(c) p = 14.7 cells/100 x lOO^m^, p = 0.588. The 
scale bar indicates 200/im. As cell density increases 
cell motility undergoes to collective ordering. The 
speed of coherently moving cells is smaller than that 
of solitary cells, (d)-(f) on the bottom panel de- 
picts the co r respo nding velocities of the cells. From 
Szabo et al.l l2006l. 



alyzed. Their data suggested that the mechanical 
injury (basically a "scratch") was not sufficient to in- 
dicate changes in the motility of the astroglia cell, 
but did result in a local enhancement in the cell pro- 
liferation. 

As discussed above, the widely accepted approach 
regarding the nature of the migration of groups of 
cells in organisms has assumed that "leading cells" 
situated at the front edge of the group guide the 
motion of all the cells. This is suggested by many 
stud i es [Vaughan and Trinkausl . Il966l iFriedj l2004l . 
Gov . l2007l |. among others bv the ones carried out 
on zebrafish, a genus whose morphogenesis and or- 
gan formation is the subject of many experim ents 



Lecaudev et al.l . I2008L iHaas and Gilmoun . 12006 
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Figure 18: Order parameter versus the normalized 
cell density. The order parameter is a measure de- 
scribing the level of coherency of the motion (for more 
details see Eq. [T]in Seq. 12. ip and the normalized cell 
density is the measured density divided by the max- 
imal observed cell density. The error bars show the 
stand ard error of the d ensity and order parameter. 



From lSzabo et all |2006l | 




Figure 19: (Color) Traction forces generated by a 
sheet of collectively moving cells, (a) is the phase 
contrast image and (b) de picts the tractions n ormal 
to the edge. Adapted from Trepat et al. 2009| . 



However, in a recent paper iTrepat et al.l |2009l | ar 



gued that traction forces driving collective cell mi- 
gration did not arise only (or primarily) in the leader 
cells which were at the front of the traveling cell sheet, 
but, as it can be seen on on Fig. [T21 in many cell 
rows behind the leading front edge cells as well. Al- 
though, like some kind of "tug of war" , the cell sheet 
as a whole moved in one direction, many cells within 
the cluster pulled the sheet in other directions. 

Cancer metastasis. Two morphological and func- 
tional variants of collective migration have been de- 



3.5 Insects 



23 



scribed in tumors in vivo. The first results from 
protruding sheets and strands that maintain contact 
with the primary site, yet generate local invasion. 
The second shows detached cell clusters or cell files, 
histologically seen as 'nests', which detach from their 
origin and frequently extend along interstitial tissue 
gaps and paths of least resi stance , as see n in epithe- 
lial cancer and melanoma Fried! 2Qq3|. Collective 
migration represents the predominant mode of tissue 
invasion in most epithelial cancers. 

Furthermore, recently it has been argued that 
malignant tumor cells may be capable of devel- 
oping collective patterns that resemble to evolved 
adaptive behaviors like collective decision-making 
or collective sensing of env ironmental conditions. 
Deisboeck and Couzin 2009| presented a concept as 
to how these abilities could arise in tumors and why 
the emergence of such sophisticated swarm-like be- 
havior would endow advantageous properties to the 
spatio-temporal expansion of tumors. 

In a recently pub lished review article 



Friedl and Gilmour 



ly pub ii 

3 j2nn9j 



readers c an find abundant literature on the topic, for 
example [Holldobler and Wilsonl . 12008 1. 

Many species of butterflies (e.g. Red Admiral, 
Painted Lady) and moths {Humming-bird Hawk- 
moth, Silver- Y moth) migrate twice a year between 
the two hemispheres: when it is autumn on the 
Northern hemisphere they form huge "clouds" and 
fly to south and come back only when spring arrives. 
Other insects being famous for exhibiting collective 
motion are ants. Many of them create tracks between 
the nest and the food sources very efficiently, using 
pheromone trails. For example New World army ant 
Eciton burchelii - whose colonies may consist of mil- 
lion or more workers - stage huge swarm raids with 
up to 200 thousand individuals forming trail systems 
that are in length up to 100 m or even more , and 20 
m wide (Gotwaldl . llQQSl [Franks et all. 119911 Based 
on the observations ICouzin and Fran ks [2003] have 
investigated the formation of these elaborated traffic 
lanes, and created a corresponding model exploring 
the influences of turning r ates and local percepti on on 



draw attention on traffic flow. Furthermore, iBeekman et al.l j200l| have 



the presumed common mechanistic themes under- 
lying the different collective cell migration types by 
comparing them at the molecular and cellular level. 
This review paper summarizes the topic from a more 
biological point of view. 

3.5 Insects 

Insects are one of the most diverse animal groups 
on Earth including more than a million described 
species which makes them re present mo r e than half of 
all known living organisms [Chapmanl . boOOj . They 
can move about by walking, flying or occasionally 
swimming. Some of their species (like water strid- 
ers) are even able to walk on the surface of water. 
Most of them live a solitary life, but some insects 
(such as certain ants, bees or termites) are social 
and are famous for their large and well-organized 
colonies. Some of these so called "eusocial" insects 
have evolved sophisticated communication system, 
such as the "round dance" and "waggle dance" of 
Western honey bee. Apis mellifera. However, motion- 
patterns based on such highly developed communica- 
tion are out of the scope of our review, but interested 



investigated another fundamental question regarding 
these formations, namely what is the minimum num- 
ber of workers that are required for this kind of self 
organization to occur. They have observed Pharaoh 
ants and they actually discovered that small groups 
forage in a disorganized way while larger ones are 
organized. Thus - for the first time - they have 
provided experimental evidence on a behavioral first- 
order phase-transition exhibiting hysteresis between 
organized and disorganized states. 

Traditionally, an aggregate is considered to be an 
evolutionarily advantageous state for its' members: it 
provides protection, information and choice of mates 
on the cost of limited resourc es and i ncrease d prob- 
ability for various infections Wilsonl . Il975aj . How- 
ever, according to some recent studies, in the case 
of some insect-species the depletion of nutritional re- 
sources m ay easily lead to cann ibalism among group- 
members. ISimpson et al. 2006| reported how the lo- 
cal availability of protein and salt influenced the ex- 
tent to which Mormon cricket bands marched, both 
through the direct effect of nutrient state on loco- 
motion and indirectly through the threat of canni- 
balism by resource-deprived specimens. Similarly, 
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Figure 20: The alignment of the motion of locusts in 
the function of animal density. The alignment is de- 
fined as the normalized average of the orientation for 
all moving animals, which means that values close to 
-1 and 1 indicate strong alignment (all locusts move 
in the same direction) whereas values close to zero 
indicate uncoordinated motion. At low densities (a), 
the alignment among individuals - if it occurs - is 
sparse and sporadic, following a long initial period 
of disordered motion (5.3-17.2 locusts/m^, equating 
to 2-7 moving locusts), (b) Intermediate densities 
(24.6-61.5 locusts/m^, equating to 10-25 moving lo- 
custs) are characterized by sharp and abrupt changes 
in direction, separating long periods of correlated mo- 
tion, (c) At densities above 73.8 locusts/m^ (equat- 
ing to 30 or more moving locusts) the alignment of 
the motion is strong and persistent, individual locusts 
quickly adopt their motion to the others, and sponta- 
neous chBi]£esJnthfi_direction do not occur. Adapted 
from [Buhl et all . |2006| . 




Figure 21: Locust swarm. From Physorg.com 



Bazazi et al. 2008| demonstrated that coordinated 



mass migration in juvenile desert locusts (see Fig. [^T|) 
was influenced strongly by cannibalistic interactions: 
Individuals in marching bands tended to bite each 
other but also risk being bitten themselves. Surgical 
reduction of individuals' capacity to detect the ap- 
proach of others from behind decreased their proba- 
bility to start moving, dramatically reduced the mean 
proportion of moving individuals in the group and 
significantly increased cannibalism as well, but it did 
not influence the behavior of isolated locusts. They 
also showed that while abdominal biting and the sight 
of others approaching from behind triggered move- 
ment, the occlusion of the rear visual field inhibited 
individuals' propensity to march. 

In a field study iBazazi et al. 2010| found that 
adult Mormon crickets were more likely to attack a 
stationary conspecific that was on the side-on than ei- 
ther head- or abdomen-on, from which it follows that 
an individual can reduce the risk of being attacked by 
aligning with its neighbors. The team also revealed 
a social effect on the cannibalistic behavior, namely 
that the more individuals were present around a sta- 
tionary cricket, the higher the probability was for an 
encounter resulting in an attack. 

Other characteristics of the collective moti on of 

2009t 



Yates et al 



locusts have also been studied: 
investigat ed the sudden coh erent switches in direc 
tion, and Buhl et al. [20061 their behavior with re 
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spect to the effect of the animal-density on the tran- 
sition between disordered and ordered states. The 
experimental results are depicted on Fig. 1201 which 
shows the alignment of the motion in the func- 
tion of locust density, for three different cases: (a) 
low density {p = 0.26 — 0.86 x 10^'^ expressed in 
terms of normalized density), (b) intermediate den- 
sity (p = 1.23 - 3.1 X 10-3) and (c) high density 
{p — 3.7 X 10^'^). Normalized density is calculated 
as usually, p = p/ Pmax, where Pmax is the maximal 
hop per densi t y esti r nated to be 20000 hopper /m^ af- 
ter [Murphvl . Il967l [& 
As it can be seen, coordinated marching behavior 
strongly depends on the animal-density. With these 
experiments they also confirmed that the transition 
followed the theoret ical predictions of the SPP-model 
Vicsek et al. I. ll995l |. and identified the critical den- 



other in a looser manner than in a school, and they 
migh t include fish of various species as well [Pitcheii 



1983j. Shoals are more vulnerable to predator at- 
tack. In contrast, in a school fish swim in a more 
tightly organized way considering their speed and di- 
rection, thus a s chool can be conside red as a spe- 
cial case of shoal Helfman et al.l . Il997l | . At the same 



time, from one second to the other a shoal can or- 
ganize itself into a disciplined school and vice versa, 
according to the changes in the momentary activ- 
ity: avoiding a predato r , resting, feeding o r traveling 



vmmons and Cressman . 2001 |. [Movie and Cech , 2003 . Hoare et al. , 2004 



sity for the onset of coordinated marching as well. 

Although zooplankton are not insects, here we 
briefiy mention an interesting study in which 
Daphnia-swarms were artificially induced to carry 
out vortex motion by using optical stimulus. When 
the density of these tiny creatures is small, they ex- 
hibit circular motion around a vertical shaft o f light . 



Ordemann et al.l 200. 



to which they are attracted, 
found that above a density-threshold a swarm-like 
motion emerges in which all Daphnia circle in the 
same - randomly chosen - direction. In order to 
reproduce the observed behavior, the authors devel- 
oped a self-propelled agent based model based on ran- 
dom walks. They found that with two ingredients of 
the model the observed circular motion can be repro- 
duced: (i) a short-range temporal correlation of the 
velocities (which is in the experiment the short-range 
alignment resulting from the water drag), and (ii) 
an attraction to a central point proportional to the 
agent's distance from it (which is in the experiment 
the attraction generated by the light beam.) 

3.6 Fish schools and shoals 

The largest groups of vertebrates exhibiting a rich set 
of collective motion patterns are certainly fish shoals 
and schools. Although these two terms cover very 
similar behaviors - and thus are often mixed - their 
meaning slightly differs: in a shoal fish relate to each 



Schooling is a very basic feature of aquatic species 
and may have a ppeared in a very early stage of verte- 
brate evolution jShaw , 1978l | . Over 50 percent of bony 
fish species school and the same behavior has been 
repo rted in a number of cartilaginous fish sp ecies as 
weh |Sha4 Il978i iBenoit-Bird and Aul . |2003| . Since 
the large-scale coherent motion of fish is also very 
important from a practical point of view (fishing in- 
dustry), the observational and simulational aspects of 
fish schools have played a central role in the studies 
o f coherent mo t ion. 

Becco et al. [2006l | recorded the trajectories of 
young fish in a school (see Fig. [22]) . Both individ- 
ual and collective behavior were studied as a func- 
tion of "fish-density" , and a transition from disor- 
dered to correla ted motion was fo und. Also by tra- 
jectory analvsis. lKatz et"aL 2011 inferred the struc- 
ture of the interactions among schooling golden shin- 
ers, Notemigonus crysoleucas. They found that it is 
not an "alignment rule" but a speed regulation which 
is the key aspect during interaction, i.e., changes 
in speed effecting conspecifics both behind and in 
front of the fish are essential. They argue that align- 
ment only modulates the strength of speed regulation, 
rather than being an explicit force itself. Another 
important claim of the study is that the observed 
interactions can not be decomposed into the sum of 
two-body interactions, but rather three-body interac- 
tions are necessary in order to explain the observed 
dynamics. 

Using a novel technique called "O cean Acoustic 
Wave guide Remote Sensing" , OAWRS [Makris et al 



2006l | , which enables instantaneous imaging and con- 



tinuous monitoring of oceanic fish shoals over tens of 
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Figure 22: Becco et al. 2006| recorded the trajecto- 
ries of young Tilapia fish in a school, (a) The photo 
of a Tilapia together with her offsprings, (b) The tra- 
jectory of 20 fish (equating to 350 fish/m^) recorded 
for 41 seconds, (c) Same as the previous one, but with 
905 fish/m^. The bar scale on sub-pictures (b) and 



(c) represents lcnix5cm. From lBecco et al.l [2006 [ 



Makris et all |2009t 



thousands of square kilometers, 
observed vast herring populations during spawning 
(see Fig. [23)) . The team observed a rapid transi- 
tion from disordered to highly synchronized behavior 
at a critical density, followed by an organized group 
migration (see Fig. 1241) . Furthermore, in agreement 
with other studies (see Sec. 13. 8p . they also found that 
a small set of leaders can significantly influence the 
actions of a much larger group. 

One of the most fundamental question regarding 
gregarious animals - thus fishes as well - is how the 
common decision is reached. If they are to stay to- 
gether, they constantly have to face questions like: 
which direction to swim, where to stop and forage, 
how to guard against predators, etc. Is it g overned 
by a l eader or by soine kin d of consensus? Reebd , 
2000l ISumpter et al] . l2008l iBiro et all . l2006l | How 
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Figure 23: (Color) OAWRS snapshots showing the 
formation of vast herring shoals, consisting of millions 
of Atlantic herring, on the northern flank of Georges 
Bank (situated between the USA and Canada) on 3 
October 2006. Adapted from iMakris et al.. (2009.] . 



does the size of th e school influence decision making? 
|GrunbaumLll998j 

Regarding the connotation of "consensus deci- 
sio n" most scholars follow t he definition proposed 
bv IConradt and Roper 2005 1. who interpreted it as 
the process in which 'the members of a group chose 
between two or more mutually exclusive actions with 
the aim of reaching a consensus', and leaderships^ 
was 'the initiation of new directions of locomotion by 
one or more individuals, which were then readily fol - 



lowed by other group members^ Krause et al. , 2000l | . 



In a recent experiment Ward et al.l 2008 1 discov- 



ered that individual fish responded only when they 
saw a threshold number of conspecifics to perform a 
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Figure 24: (Color online) The results obtained 
from evaluating the data recorded by the technique 
called "Ocean Acoustic Waveguide Remote Sensing" 
(OAWRS), see Fig. M (a) The length of the three 
forming shoals (on the left, depicted by red, blue and 
black colors online) and the migration distance (bot- 
tom of the picture, green online) in the function of 
time. The solid lines are the best-fit slopes to the 
recorded data, (b) and (c) population density ver- 
sus time for shoal 1 (blue data online) and shoal 2 
(red data online). A slow growth in population den- 
sity is followed by a rapid increase immediately af- 
ter the critical fish-density is reached {O.lSfish/ni^ 
corresponding to approximately p = 0.027 normal- 
ized density. The normalized density is defined as 
p — p/pmax, where Pmax IS the maximal observed 
density, approximately 6 .6 fish/w^ acc ording to sub- 
figure h). Adapted from iMakris et all [2009.] . 



particular behavior ( "quorum responses" ) . They ex- 
perimentally investigated (and also modeled) the de- 
cision making process about movemen ts of a school 
in the case of a specific kind of fish. iReebsl |2000ll 
trained twelve golden shiners to expect food around 
midday in one of the brightly lit corners of their tank 
and investigated whether these informed individuals 
were able to lead their shoal-mates to the site of the 
food source later or not. He found that a minority of 
informed individuals (even one) can lead a shoal to 
the food-site. He also observed that the shoals never 
split up and were always led by the same fish. 

Some of the experiments suggesting these results 
utilized "replica fish" or fish ro bots in order to study 



Faria et al 



the decision-makin g behavior [Sumpter et al, 
2010aj . 



2008 



3.7 Bird flocks 

Flocking of birds have been the subject of specula- 
tion and investigation for many years. Some of the 
nearly paradoxical aspects of the extremely highly- 
coordinated motion patte rns were po inted out al- 
ready in the mid 1980-es Pottsl . Il984| . In this pa- 
per Potts discussed how the flock movements were 
initiated and coordinated, through a frame-by-frame 
analysis of high-speed film of sandpiper flocks. He 
argued that any individual can initiate a flock move- 
ment, which then propagates through the flock in a 
wave-like form radiating out from the initiation site. 

Research has investigated various features of 
the group flight of birds, including positio nal ef- 
fects on vigilance (main ly anti-predatory) [Elgai . 
19891 iBeauchamnl l2003t . flock size, positional ef- 
fects and intra-specific aggressi on in European star- 
Hngs Keys and Dueatkin , 19901 . l anding mechanisms 
Bhattacharva and VicseM 2010l |. Skeins of wild 



geese are famous for their characteristic V-shaped 
for mations, w h ich w as spatio-temporally analyzed 
by iHavakawal [2010l |. By performing field mea- 



sures, he observed long-term fluctuations with single- 
sided propagation through the string, and proposed 
a corr esponding model as well. iParrish and Hamnei 



1997l | published a remarkable collection of papers 
about the state of the art of the research on animal 
congregations in three dimensions. The most recent 
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and impressive experimental observational study was 
carried out within the framework of a EU FP6 NEST 
project (Starflag, 2005-07). In this project the team 
measured the 3D positions of individual birds (Euro- 
pean Starlings, Sturnus vulgaris) within flocks con- 
taining up to 2,600 individuals, using stereometric 
and computer vision techniques (see Fig. [25]). They 
characterized the structure of the flock by the spa- 
tial distribution of the nearest neighbors of each bird. 
Given a reference bird, they measured the angular 
orientation of its nearest neighbor with respect to the 
flock's direction of motion, and repeated this process 
for all individuals within a flock as reference bird. 
Figure [26l depicts the average angular position of 
the nearest neighbors. The important main observa- 
tion of the research team in Rome was that starlings 
in huge flocks interact with their 6-7 closest neigh- 
bors ( "topological approach" ) instead of those being 
within a given distance ("metrical approach"). Thus, 
they argued, the effect of density was quantitatively 
different in these (and probably most) flocks from 
that one would expect from m odels assuming a spa - 



2008j . 



tially limited interaction range [Ballerini et al. 
A topological flock model b ased on the above fi ndings 
was recently considered by iBode et all boilal . 

On the other hand, other experiments - concerning 
various other species - rendered the opposite view 
also probable, namely that the range of inter action 



did not change with density jBuhl et aL , 2006| . This 



question is still the subject of investigations, and it 
may easily lead to the conclusion that this mechanism 
di ffers from species to species. 

Cavagna et all |2010t obtained high resolution spa- 



tial data of thousands of starlings using stereo imag- 
ing in order to calculate the response of a large flock 
to external perturbation. They were attempting to 
understand the origin of collective response, namely 
the way the group as a whole reacts to its environ- 
ment. The authors argued that collective response in 
animal groups may be achieved through scale-free be- 
havioral correlations. This suggestion was based on 
measuring to what extent the velocity fluctuations 
of different birds are correlated to each other. They 
found that behavioral correlations decay as a power 
law with a surprisingly small exponent, thereby pro- 
viding each animal with an effective perception range 
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Figure 25: (Color online) A typical starling flock and 
its 3D reconstruction, (a) and (b) is the photograph 
of one of the analyzed flocks. The pictures were made 
at the same moment by two different cameras, 25 me- 
ters apart. For reconstructing the flocks in 3D, each 
bird's image on the left had to be matched to its cor- 
responding image on the right. The small red squares 
indicate five of these matched pairs, (c-f) The 3D re- 
constructions of the analyzed flock from four different 
perspectives, (d) The reconstructed flock from the 



same view-point as (b). From Ballerini et al. 2008| 



much larger than the direct inter-individual interac- 
tion range. Further simulations are needed to clarify 
the origin of the experimental findings. 

A very recent direction (made possible by techno- 
logical advances) is to obtain information about the 
position of individual birds during the observations 
using ultra light GPS devices (see Fig. [ST]). Although 
the present technology is still not suitable for large 
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individually. Employi ng high-precision GPS track 



Figure 26: (Color online) The average angular den- 
sity of the birds' nearest neighbors. The map shows a 
striking lack of nearest neighbors along the direction 
of motion, thus the structure is strongly anisotropic. 
(A possible explanation for this phenomenon might 
lie in the anatomical structure of this genera's visual 
apparatus.) According to the authors, the observed 
anisotropy is the effect of the interaction among the 
individuals. Adapted from iBallerini et al.l 200S 




Figure 27: (Color online) A pre-trained homing pi- 
geon with a small GPS device on his back, a recent 
technology to obtain informa tion about the pos ition 
of the individual birds. From Nagv et al. 2010l |. 



scale, high-precision studies (only a couple of birds 
per experiment and a resolution of the order of me- 
ters have been achieved yet), thi s method has a l ready 



called to forth imp ortant results [Roberts et al.L 12004 , 



caliea to lortnimp< 
lAkos et alLboOsj . 

Applying GPS data-loggers in six highly pre- 
trained p igeons, the efficiency of a flock was investi- 



gated bv iDell'Ariccia et al.l |2008t . They found that 



the homing performance of the birds flying as a flock 
was significantly better than that of the birds released 



ing of pairs of pigeons iBiro et al 2006| found that 



if confiict between two birds' directional preferences 
was small, individuals averaged their routes, whereas 
if conflict arose over a critical threshold, the pair split 
or one of the birds became the leader. 

Using a similar method, track-logs ob tained from 
high-p recision lightweight GPS devices, iNaev et al. 
2010l | found a well-defined hierarchy among pigeons 



belonging to the same flock by analyzing data con- 
cerning leading roles in pairwise interactions (see Fig. 
28)) . They showed that the average spatial position 
of a pigeon within the flock strongly correlates with 
its place in the hierarchy. 

One of the long standing questions about the col- 
lective behavior of organisms is the measurement and 
interpretation of their positions relative to each other 
during flocking. Precise data of this sort would make 
the reconstruction of the rules of interaction between 
the i ndividual organisms po ssible. In a very recent 
paper Lukeman et al. 2010j | carried out an investiga- 
tion with this specific goal. They analysed a high- 
quality dataset of flocking surf scoters, forming well 
spaced groups of hundre ds of individual s on th e wa- 

[20inj 



Lukeman et al 



were 



ter surface (Fig. 
able to fit the data, to zo nal interaction models (see, 
e.g.. lCouzin et al.l (2002| ) and characterize which in- 
dividual interaction forces suffice to explain observed 
spatial patterns. The main finding is that impor- 
tant features of observed flocking surf scoters can 
be accounted for by zonal models with specific, well- 
defined rules of interaction. 

3.8 Leadership in groups of mammals 
and crowds 

Many insect, fish and bird species live in large groups 
in which members are considered to be identical 
(from the viewpoint of collective motion), unable to 
recogni ze each other on a n individual level (although 
not all, [Nagv et al.ll201CI |). Such groups might reach 
a consensus either without leader (by quorum re- 
sponse, mean value, etc.) or with a leader. However, 
even in this latter case, leadership is temporal since 
it is based on temporal differences, such as pertinent 
information of food location or differences in some 
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Figure 28: (Color online) The route of a flight and the 
corresponding leadership-network of a pigeon flock, 
(a) A two-minute segment of the trajectory of ten 
pigeons recorded by small GPS devices (as depicted 
on Fig. B7)) . The different letters (and colors on- 
line) refer to the different individuals. The small dots 
on the lines indicate 1 second, the triangles indicate 
5, and they point in the direction of the flight, (b) 
The leadership-network for the flight depicted on sub- 
figure (a). Each node (letter) represent a bird, among 
which the directed edges point from the leader to the 
follower. The numbers on the edges indicate the time 
delay (in seconds) in the two birds' motion. For those 
bird-pairs which are not connected directly with each 
other with an edge, directionality could not be re- 
solve d by means of the applied threshold. Adapted 



from lNagv et all |2010l |. 




Figure 29: (Color online) A flock of surf scoter (M. 
perspicillata) swimming on the water surface (A). 
The actual coordinates and velocities after correc- 
tion for perspective a nd drift currents effects. After 



Lukeman et al. 2010l |. 



inner states (hunger, spawning inducement, etc). As 
an important difference, most mammals do have the 
capacity for individual recognition enabling the emer- 
gence of hierarchical group structures. Although the 
assumption that the dominant individuals are at the 
same time the ones that lead the herd seems quite 
plausible, in fact, recent biological studies reveal that 
in many cases there is no direct relationship between 
dominance and leadership. Most probably it is an in- 
teraction among kinship, dominance, inner state and 
some outer conditions. 

Zebras, like many other mammals, need signifi- 
cantly more water and energy durin g the lactation 



period than they need otherwise. iFischhofF et al 



2007l | investigated the effect of two factors, iden- 



tity and inner state, on leadership in herds of ze- 
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bras, Equus burchellii. "Identity" covers both dom- 
inance and kinship, while the inner state was inter- 
preted as the reproductive state (if the individual is 
in its lactation period or not). Zebra harems consist 
of tightly knit individuals in which females were ob- 
served to have habitual roles ( "personal differences" ) 
in the initiation of group movements. The authors 
also found that lactating females initiate movements 
more often than non-lactating ones, thus lactation, 
as inner state, plays an important role in leader- 
ship. Others find more d irect relationship to hier- 
archy. Sarova et al.l 201Cl| recorded the motion of a 
herd of 15 beef cows. Bos taurus, for a three-week 
period using GPS devices. They found that short- 
distance travels and foraging movements are not lead 
by particular individual, instead, they are rather in- 
fluenced in a graded manner, i.e., the higher an in- 
dividual was in the group hierarchy, the bigger influ- 
ence it exerted on the motion of the herd. Accord- 
ing to the observations. Rhesus macaques {Macaca 
mulatto) preferred to join related or high-ranking in- 
dividuals too, whereas Tonkean macaques {Macaca 
tonkeana) exhibi t ed no specific order at departure 
Sueur and Peti d . 2008 [. In a recent review article 



members are needed to lead the group. iDver et al 
2008| tested these predictions on human groups in 



Petit and BonI [201 0*1 interpreted the process of col- 
lective decision making (regarding group movements) 
as a combination of two kinds of rules: 'individual- 
based' and 'self-organized'. The first one covers the 
differences of the [mostly inner] states of the an- 
imals, that is, differences in social status, physi- 
ology, energetic state, etc. The second one, self- 
organization, corresponds to the interactions, simple 
responses among individuals. 

Regarding the case when leadership emerges solely 
from differences in the inner states of the group mem- 
bers (those ones lead wh o have pertinent informa- 
tion) , ICouzin et al. I [2005j suggested a simple model 
to show how a few informed individuals can lead a 
whole group. In this model (which is detailed in Sec. 
5.4|) group members do not signal and do not know 
which of them (if any) has information regarding the 
desired direction. This model predicts that even if 
the portion of the informed individuals within the 
group is very small, the group as a whole can achieve 
great accuracy in its movement. In fact, the larger 
the group size, the smaller the portion of informed 



which the experimental subjects were naive and they 
did not use verbal communication or any other ac- 
tive signaling. The experiments indeed supported the 
predictions. Other experiments investigated the re- 
lationship between the spatial position of informed 
individu als and the speed and accuracy of the group 



motion 



Dver et al 



2009^ . The results proved valid 
in larger crowds as well (100 and 200 people) which 
can have important implications on plans aiming to 
guide human groups for example in case of emer- 
gency 



Faria et al. 2010bj | studied the effect of the knowl- 



edge regarding the presence and identity of a leader in 
small human groups, and also investigated those in- 
advertent social cues by which group members might 
identify leaders. With this object they conducted 3 
treatments: in the first, participants did not know 
that there was a leader, in the second treatment they 
were instructed to follow the leader but they did 
not know who it was, while in the third they knew 
who the leader was. The experiments took place in 
a circular area with lOm diameter labeled by num- 
bers from 1 to 16. These marks were spaced equally 
around the perimeter, as shown in Fig. 1301 In all the 
trials, participants were instructed (i) not to talk or 
to make any gesture, (ii) to walk continuously, and 
(iii) to remain together as a group. Further instruc- 
tions were provided on a piece of paper: a (randomly 
chosen) person was asked to move to a (randomly 
chosen) target but stay with the group. She/he was 
the "informed individual" , the "leader" . The rest of 
the group was uninformed whose instructions differed 
from treatment to treatment: In the first one, they 
were only asked to stay with the group. In the sec- 
ond treatment they were told to follow the leader, but 
they did not know who it was. In the third one, they 
were asked to follow the leader whose identity was 
provided (by the color if his/her sash). Although the 
accuracy of the group movement significantly differed 
from treatment to treatment, the leader always suc- 
ceeded to guide the group to the target. The least ac- 
curate group motions were measured during the first 
treatment, while the second and third ones resulted 
group motions whose accuracy were close to the pos- 
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s 



Figure 30: (Color online) Orientations (arrows) and 
walking trajectories (lines) of the eight participants 
during the second treatment. The colors identify the 
participants. The leader - marked by a '*' on sub- 
picture (a) - was instructed to reach the randomly 
selected target which is marked by a '§'. (a) depicts 
the situation at the b eginning of the trial and (b) 25 
s later. Adapted from Faria et al] 2010b| . 



sible maximum value. Three main factors were ex- 
posed as inadvertent social cues that might help un- 
informed group members to identify the leader(s): (i) 
time to start walking - informed individuals usually 
started walking sooner, (ii) distance from the group 
center - leaders were farther from the center than 
others, and (iii) proportion of time spent following - 
informed people spent significantly less time follow- 
ing. 

Many authors study animal groups from the view- 
point of a cost-benefit interpretation. They highlight 
that for an individual, living in a group brings more 
benefit than disadvantage, which is after all the ul- 



timate reason for group formation. However, when 
reaching a consensus, if individuals differ in state and 
experience - which is reasonable to assume - then 
some individuals will have to pay bigger "consensus 
costs" than others (which is the coast that an individ- 
ual pays by foregoing its optimal behav ior to defer to 
the common decision [King et ah , 2008| ) . Theoretical 
models estimate "democratic decisions" less costly 
(in terms of average consensus cost) than "despotic 



decisions" [Conradt and Ropen . which estima- 



tion is supported by a number of observations as well 
Conradt and Rope However, many animal 



groups (including primates and humans) often fol- 
low despotic decisions. Field experimen ts (for ex- 
ample on wild baboons King et all . l2008l |) highlight 
the role of social relationships and leader incentives 
in such cases. From a m ore theoretical viewpoint, 
Conradt and Roper (2010| discussed the cost/benefit 
ratio during group movements, separately for timing 
and spatial decisions. 

In his recent book on collective animal behavior, 
Sumpteil |20ld| dedicated a whole chapter to decision 
making. 

3.9 Lessons from the observations 

The main, commonly assumed advantages of flocking 
are: 

1. Defense against predators 

2. More efficient exploration for resources or hunt- 
ing 

3. Improved decision making in larger groups (e.g., 
where to land) 

In general, it can be argued that with the increas- 
ing size of a group the process of decision making 



is lik e ly to become mo r e effic i ent ICamazine et al 



200 ll IConradt and Listl . l2009l . iKrause et all . |2010| . 



In addition, based on the numerous observations the 
following hypotheses can be made about the nature 
of the patterns of motion arising: 

1. Motion and a tendency to adopt the direction of 
motion of the neighbors is the main reason for 
ordered motion. 
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2. Apparently the same, or very similar behaviors 
occur in systems of very different origin. This 
suggests the possibility of the existence of uni- 
versal classes of collective motion patterns. 

3. Boundary conditions may significantly affect the 
essential features of flocking. 

4. Collective decision making is usually made in 
a globally highly disordered, locally moderately 
ordered state (associated with a relatively slowly, 
but consistently decaying velocity correlation 
function) in which large scale mixing of the local 
information is enhanced. 

4 Basic models 




Figure 31: (Color online) The three basic steering be- 
haviors determining the motion of the objects (called 
"boids"). (a) Separation, in order to avoid crowding 
local flock-mates. (Each bold reacts only to flock- 
mates within a certain neighborhood around itself, 
they are the "local flock-mates".) (b) Alignment: 
objects steer towards the average heading direction 
of their local flock-mates, (c) Cohesion: objects 
move toward the average position of their neighboring 
boids. From http : / /www . redSd . com/cwr /boids/. 



4.1 Simplest self-propelled particles 
(SPP) models 

Modeling of flocks has simultaneously been consid- 
ered by the, initially somewhat divergent communi- 
ties of computer graphics specialists, biologists and 
physicists. Perhaps the first widely-kn o wn fl ocking 
simulation was published by iRevnolds 1987 1, who 
was primarily motivated by the visual appearance of 
a few dozen coherently flying objects, among them 
imaginary birds and spaceships. His bird-like ob- 
jects, which he called "boids", moved along tra- 
jectories determined by differential equations tak- 
ing into account three types of interactions: avoid- 
ance of collisions, heading in the direction of the 
neighbors and finally, trying to stay close to the 
center of mass of the flock, as illustrated on Fig. 
1311 The model was deterministic and had a num- 
ber of relatively easily adjustable parameters. The 
website http://www.red3d.com/cwr/boids/, cre- 
ated and maintained until 2001 by Reynolds, is a 
unique source of links to all sorts of information (pro- 
grams, demos, articles, visualizations, essays, etc.) 
related to group motion. 

Reynolds's model shares featu r es wit h an earlier 
simulation carried out by lAokil |1982| , who used 
the following rules (similar to those assumed by 
Reynolds) in order to simulate the collective motion 



of fish: (a) avoidance, (b) parallel orientation move- 
ments and (c) approach. The speed and direction of 
the individuals were considered to be stochastic, but 
the direction of the units was related to the location 
and heading of the neighbors (the velocity compo- 
nent, for the sake of simplicity, was considered to be 
independent of other individuals). In this pioneering 
paper of the field it was already stated that collective 
motion can occur without a leader and the individ- 
uals having information regarding the movement of 
the entire school. 

In order to establish a quantitative interpretation 
of the behavior of huge flocks in the presence of 
perturbations, a statistical physics type of approach 
to flo cking was introduced in 1995 by IVicsek et al. 



1995j . which nowadays is widely referred to as "Vic- 
sek Model" fVMl e.g.. iBadietto and Albanol. 12008 
le 



2009a. Kulinskii and C 



2008aL IZhiXin and Leil . l2008l Ijadbabaie et all . 12003 



Ginelh et al.l . l2010l |. In the present paper we will 
refer to this approach as the "SVM", correspond- 
ing to Standard Vicsek Model as s u ggest ed in 



Huepe and Aldanal . l2008l iBertin et all \200^ . In 



this model the perturbations, which are considered 
to be a natural consequence of the many stochas- 
tic and deterministic factors affecting the motion of 
the flocking organisms, are taken into account by 
adding a random angle to the average direction (Eq. 
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[T5|) . In this cellular-automaton- like approach of self- 
propelled particles (SPP-s) the units move with a 
fixed absolute velocity Vq and assume the average di- 
rection of others within a given distance R. Thus, the 
equations of motion for the velocity (vl) and position 
{xi) of particle i having neighbors labeled with j are 



Vi{t + 1) = Vq- 



+ perturbation (13) 



X^{t+1) ^ Xi{t) + Vi{t + 1) 



(14) 



Here (. . .)^ denotes averaging (or summation) of the 
velocities within a circle of radius R surrounding par- 



ticle i. The expression 



provides a unit vector 



pointing in the average direction of motion (charac- 
terized by its angle ^i{t) ) within this circle. It should 
be pointed out that the processes accounted for by 
such an alignment rule can be of very different origin 
(stickiness, hydrodynamics, pre-programmed, infor- 
mation processing, etc). Perturbations can be taken 
into account in various ways. In the standard ver- 
sion they are represented by adding a random angle 
to the angle corresponding to the average direction of 
motion in the neighborhood of particle i. The angle 
of the direction of motion 'di{t + 1) at time t + 1, is 

obtained from 'di{t) — arctan 



<Vj,x>R 



<Vj,y>R 



(15) 



where Vj^x and the X and y coordinates of 

the velocity of the jth particle in the neighborhood 
of particle i, and the perturbations are represented 
by Ai(i), which is a random number taken from a 
uniform distribution in the interval [— r/7r, 777r] (i.e., 
the final direction of particle i is obtained after ro- 
tating the average direction of the neighbors with a 
random angle). The only parameters of the model 
are the density p (number of particles in a volume 
R'^, where d is the dimension), the velocity vq and 
the level of perturbations 77 < 1. For order param- 
eter ip, the normalized average velocity is suitable, 

V=w^ E^Ii '^'i > as defined by Eq. 

This extremely simple model allows the simulation 
of many thousands of flocking particles and displays a 
second order type phase transition from disordered to 




Figure 32: Order parameter (tp) versus noise (77) in 
the SVM. (a) The different kind of points belong to 
different system sizes, (b) The different curves belong 
to different vq velocities, with which each particles 
move. As it can be seen, the concrete value of t^o 
does not effect the nature of the transition (except 
when Vq — 0, that is, wh en the units do not move at 
aU). (a ) is adapted from 'Czirok et al. 1997j and (b) 
is from Baglietto and Albang [2009b| ^ 



an ordered (particles moving in parallel) state as the 
level of perturbations is decreased (see Fig. [5^ . At 
the point of the transition features of both order and 
disorder are simultaneously present leading to flocks 
of all sizes (and an algebraically decaying velocity 
correlation function) . 



Shimovama et al. 



jl996{ proposed a mathematical 
model (neglecting noise) from which they obtained 
a categorization of the different types of collective 
motion patterns and determined the corresponding 
phase diagrams as well. 

As we shall see in the upcoming sections, by vary- 
ing some parameters, initial conditions and settings, 
the simulations exhibit a rich variety of collective mo- 
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tion patterns, such as 'marching groups', mills, rotat- 
ing chains, bands, etc. (see Sec. I4.2l and l4?3)) . In some 
cases (i.e. by applying some certain parameter and 
initial condition settings) these ordered phases can 
exhibit some remarkable features as well, such as gi- 
ant number fluctuations (GNF, see for example page 
l40l [52)1 or band formation. According to the studies, 
noise, density, the type of interaction (attractive or 
repulsive, polar or apolar, the range of the interac- 
tion) and the boundary conditions (in case of finite 
size models) all proved to play an important role in 
the formation of certain patterns. 

4.1.1 The order of the phase transition 

In the pape r introducing the original variant (OVM) 
of the SVM IVicsek et al.l . lT995j . a second order phase 
transition from disordered to ordered motion was 
shown to exist. In particular, in the thermodynamic 
limit, the model was argued to exhibit a kinetic phase 
transition analogous to the continuous ones in equi- 
librium systems, that is. 



'P^ [p- Pc{v)t 



which defines the behavior of the order parameter 
at criticality, in the case of a standard second order 
transition. /3 and S are critical exponents, 77 is the 
noise (in the form of random perturbations), p is the 
particle density, and r]c{p) and pdv) ^-re the critical 
noise and critical density, respectively, for L ^ 00. 
{L is the linear size of the system.) 
However, the continuous nature of this transition 



has been questioned [Gregoire and Chata . 12004 



re- 



sulting in a number of studies investigating this fun- 
damental a,spect of col l ective motion. Chate and 



coauthors Chate et al. . 2008bl | . in their extensive 



follow-up study, presented numerical results indicat- 
ing that there exists a "crossover" system size, which 
they call L* , beyond which the discontinuous char- 
acter of the transition appears independent of the 
magnitude of the velocity. They demonstrate that 
this discontinuous character is the "true" asymp- 
totic behavior in th e infinite-size limit. Importantly, 
Chate et al. 2008b| | showed and presented results in 



favor of their picture that L* diverges in various lim- 
its: both the low and high density limits, as well as 
in the small velocity limit. In particular, an extrap- 
olation of their estimates towards the small velocity 
regimes considered in prior works gives values of L* 
so large that do not make the corresponding simula- 
tions feasible. 

Studies aiming to reveal the nature of the above 
phase transition (whether it is first or second or- 
der) find that the noise (more precisely, the way it 
is introduced into the system), and the velocity with 
which the particles move, play a key role. Accord- 
ingly, while simulations show that for relatively large 
velocities (fn > 0.5) the tran sition is discontinuous, 
iBaglietto and Albanol 2009a ) demonstrated that for 
smaller velocities, even in the limit when the veloc- 
ity goes to zero (except when it is exactly equal to 
zero), the transition to ordering is continuous (is in- 
dependent of the actual value of the vel ocity , as it 
|32] b). Very recently |lhk 



can be seen in Fig 



and Mishra et al 



2011 | 



[2010] were able to see band-like 
structures in their solutions obtained from a contin- 
uum theory approach. Bands usually sig nal first or- 
der phase transition, however. llhle 201ll found them 

|2010l | 



(16) for a large velocity case, while iMishra et al 



assumed throughout their calculation that the tran- 
sition from disorder to order was continuous. 



Aldana et al.l |2007l | demonstrated that the type of 



the phase transition depends on the way in which the 
noise is introduced into the system. They analyzed 
two network models that capture some of the main 
aspects characterizing the interactions in systems of 
self-propelled particles. In the so called "vectorial 
noise model" the perturbation (in the form of a ran- 
dom vector) is first added to the average of the veloc- 
ities and the final direction is d etermined only after 
this [Greg oire and Chatel 12003 ]. When the average 
velocity is small (disordered motion) this seemingly 
subtle difference in the definition of the final direction 
leads to a qualitatively different ordering mechanism 
(sudden - first order-type - transition to the ordered 
state). 

Correspondingly, ana et ahl [2009] analyzed the 
order-disorder phase transitions driven by two dif- 
ferent kinds of noises: "intrinsic" (the original form, 
perturbing the final angle) and "extrinsic" (the vec- 
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torial one, perturbing the direction of the individ- 
ual particles before averaging). Intrinsic is related 
to the decision mechanism through which the par- 
ticles update their positions, while extrinsic affects 
the signal that the particles receive from the environ- 
ment. The first one calls continuous phase transitions 
forth, whereas the se cond type produces di scontinu- 



ous phase t r ansiti ons [Pimentel et al.l . I2008j . Finally, 



Nagy et al.l |2007j showed that vectorial noise results 



in a behavior which can be associated with an insta- 
bility. 

4.1.2 Finite size scaling 

So far, the most complete study regarding the scaling 
behavior of systems of self-propcUcd particles exhibit- 
ing simple a hgnment plus perturbation, h as been car- 



ried out by iBaglietto and Alband [2008j. They per- 
formed extensive simulations of the SVM, and ana- 
lyzed them both by a finite-size scaling method (a 
method used to determine the values of the criti- 
cal exponents and of the critical point by observing 
how the measured quantities vary for different lat- 
tice sizes), and by a dynamic scaling approach. They 
observed the transition to be continuous. In addi- 
tion they demonstrated the existence of a complete 
set of critical exponents for the two dimensional case 
(including those corresponding to finite size scaling 
and numerically determined their values as well. In 
particular, within the framework of finite-size scaling 
theory, the scaling ansatz for the order parameter ip 
of the SVM has been rewritten as 



^(r;,i)=L-'5/^^(r;-r;,)Ll/^ 



(17) 



where L is the finite size of the system, is a suitable 
scaling function, and finally, (3 and v are two of the 
critical exponents in question: /? is the one belonging 
to the order parameter, and v is the correlation length 
critical exponent. 



^Numerical simulations carried out on systems having fi- 
nite size L in at least one space dimension exhibit so called 
finite size effects, most importantly rounding and shifting ef- 
fects during second-order phase transitions. These artifacts are 
particularly emphasized near the critical points, but they can 
be accounted for by mean s of the so called finite-size scaling . 
See more on this topic in [Cardvl 1 19961 . iBrankov et~an . 12000 



Similarly, the fluctuation of the order parameter, 
X = (T^L^, takes the form 



(18) 



where x is a suitable scaling function, 7 is the sus- 
ceptibility critical exponent, and = ("ys^) — (v)^ is 
the variance of the order parameter. In the thermo- 
dynamic limit, X obeys X ^ iv~ Vc)~"'- (See also Eq. 

O) 

Equations (flT)) and (|T8l) are convenient to deter- 
mine the critical exponents within the framework of 
finite size scaling theory. As a crucial result, the au- 
thors found that the exponents they calculated satisfy 
the so-called hyperscaling relationship 



(19) 



which is, in general, valid for standard (equilibrium) 
critical phenomena, d denotes the dimension, d ~ 2. 

The nature of "intermittency" - intermittent 
bursts during which the order is temporarily lost in 
such systems - has also been a subject of investiga- 
tions recently Huepe and Aldanal . 12004 1. 



4.2 Variants of the original SPP 
model 

Several variants of the above-introduced, simplest 
SPP model have been proposed over the years. One 
of the main directions comprises those studies that 
investigate systems in which the particles (units) do 
not follow any kind of explicit alignment rule, only 
collisions occur between them in the presence of some 
kind of interaction potential. We shall overview this 
approach in Sec. 14.2.11 Models assuming some kind 
of alignment rule for the units, will be dealt with in 

Sec. w?n\ 

4.2.1 Models without explicit alignment rule 

As mentioned in Sec. 14. 1[ in the most simple SPP 
models, an alignment term is assumed. However, 
according to very recent studies (see Sec. 13.21) . the 
motion of particles may become ordered even if no 
explicit alignment rule is applied, but alignment is 
introduced into the collision in an indirect way by 
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the local interaction rules. The simplest (most min- 
imal) model of ordered motion emerging in a system 
of self-propelled particles looks like this: The parti- 
cles are trying to maintain a given absolute velocity 
and the only interaction between them is a repulsive 
linear force (F) within a short distance (i.e., they do 
not "calculate" the average of the velocity of their 
neighbors, and the only interaction is through a pair- 
wise central force). The corresponding equations are: 



dt 



(20) 



where is noise (random perturbations, typically 
white noise) 



F, (wall) 



F — 







In, I 



,if 



< To, and 



, otherwise 



(21) 



(22) 



(23) 



Simulations of the above minimal model result in 
a first order trans ition from di s order ed to coherent 
collective motion [Perzsi et al. . 2009| . as it can be 
seen in Fig. |33l 

Analogous results were recently obtained for 
another simple model assuming only a specific 
form of inelastic colli sions between the particles 



Grossman et al. . 2008| . In their numerical exper- 



iments, self-propelled isotropic particles move and 
collide on a two-dimensional frictionless flat surface. 
Imposing reflecting boundary-conditions produce a 
number of collective phenomena: ordered migration, 
the formation of vortices (see Fig. [M)) and random 
chaotic-like motion of subgroups. Changing the par- 
ticle density and the physical boundary of the system 
- for example from a circular to an elliptical shape - 
again results in different types of collective motion; 
for certain densities and boundary-types the system 
exhibits nontrivial spatio-temporal behavior of com- 
pact subgroups of units. The reason why coherent 
collective motion appears in such a system is that 
each of these inelastic collisions between isotropic 
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Figure 33: (Color online) Probability density dis- 
tribution of the order parameter versus noise for 
1200 particles. The first order nature of the tran- 
sition is indicated by the behavior of the order 
parameter, depicted on the vertical axis, which 
abruptly falls, in this case at noise level 0.007. From 
http : //hal . elte . hu/~vicsek/SPP-minimal/. 




Figure 34: (Color online) Vortex formation in a re- 
flective round boundary. Reflecting boundaries cause 
particles to move parallel to them. Both clockwise 
and counter clockwise vortices can form according to 
the randomly chosen initial direction, (a) A snap- 
shot of the particles (TV = 900). (b) Their movement 
within a short period of time, (c) Coarse g raining 
average velocity. From [Grossman et al. 2008 1. 



particles induce alignment, resulting in an increased 
overall velocity correlation (it can be shown that the 
collisions do not preserve the momentum, but lead to 
at least a slight increase each time). Such numerical 
experiments are fundamental in clarifying the ques- 
tion regarding the minimal requirements for a system 
to exhibit collective motion, based solely on physical 
interactions. 

Stromboml |2011 also considered an SPP model 



in which only one kind of social interaction rule was 
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Figure 35: (Color online) (a) A "mill", (b) a "rotating 
chain" without intersection, (c) with on e junction, 
and ( d) with two self-intersections. From [stromboin 
201 1| . 



taken into account: attraction. By using simulations 
he found a variety of patterns, such as swarms (a 
set of particles with low and varying alignment), 
undirected mills (a group in which the particles 
move in a circular path around a common center) 
and moving aligned groups (in which the units 
move in a highly aligned manner). Importantly, 
these structures were stable only in the presence 
of noise. Introducing a blind angle (which is the 
region behind each unit in which other particles 
are "invisible" , and which, accordingly, incorpo- 
rates some sort of alignment into the system) had 
a fundamental effect on the emergent patterns: 
undirected mills become directed, and "rotating 
chains" appeared (see Fig. [35]). In these chains 
the units move on a closed curve having zero (Fig. 
155b). one (Fig. [55b ) or two (Fig. [SSH ) junctions. 
These formations are called "rotating", because the 
chains with zero or two intersections often rotate 
around a slowly moving axis. (Some correspond- 
ing videos can be seen on the author's webpage, 
https : //sites . google . com/site/danielstrmbm/ 
research.) 

The first work in which the relevance of the si- 



multaneous presence of volume exclusion and self- 
propulsion for a n effective align ment of the particles 



was published bv [Peruani et al.l [2006]. They stressed 



the importance of the particle shape by showing that 
self-propelled objects moving in a dissipative medium 
and interacting by inelastic collision, can self-organize 
into large coherently moving clusters. Their simu- 
lations have direct relevance to the experiments on 
shaken rods [KudroUiL [ 2010l | and on the co l lectiv e 



motion patte rns by mixobacteria |Wu et al.l . [200 



Furthermore, Peruani et al. 2006| showed that self- 
propelled rods exhibit non-equilibrium phase transi- 
tion between a monodisperse phase to an aggregation 
phase that depends on the aspect ratio and density 
of the self-propelled rods. To see all this, no specific 
boundary conditions had to be applied due to the 

elongated shape of t he particles. 

In a similar spirit, Ginelli et al. 2010| investigated 
in more detail the properties of a collection of elon- 
gated, asymmetric ( "polar" ) units moving in two di- 
mensions with constant speed, interacting only by 
"nematic collisions", in the presence of noise. Ne- 
matic collision, illustrated on Fig. [36l means the 
following: if the included angle of the two veloc- 
ity vectors belonging to the colliding rod-like units 
was smaller than 180° before they impinge on each 
other, they would continue their motion in the same 
direction, in parallel, after the collision. If this an- 
gle was bigger than 180°, then they would continue 
their travel in parallel, but in the opposite direc- 
tion. Four phases were observed, depending on the 
strength of the noise (labeled I to IV by increasing 
noise- values, see Fig. [37]). Phase I is spatially ho- 
mogeneous and ordered, from which phase II differs 
in low-density disordered regions, which appear in 
the steady state. The order-disorder transition oc- 
curs between phases II and III. Both of these phases 
(II and III) are characterized by spontaneous segre- 
gations into bands, but in phase III these bands are 
thinner and are more unstable, constantly bending, 
breaking, reforming and merging, displaying a persis- 
tent space-time chaos. Phase IV is spatially homoge- 
neous with global and local disorder on small length 
and timescales. 



In the large scale experiments of [Schaller et al. 



2010l| propagating density waves were observed and 
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Figure 36: Nematic collision means that, if the in- 
cluded angle of the two velocity vectors belonging to 
the colliding rod-like units was smaller than 180° be- 
fore they impinge on each other, they would continue 
their motion in the same direction, in parallel, after 
the collision. If this angle was bigger than 180°, then 
they would continue their tr avel in paraUel, bu t in 



the opposite direction. From Ginelli et al. 2010| . 
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Figure 37: Steady-state s napshots for t he fo ur dif 



2010^ . The 



ferent phases observed by ICinelli et al. 
linear size is L = 2048. Arrows show the orienta- 
tion of particles (except in (d)). The phases belong 
to different noise values: (a) ry = 0.08, (b) r/ — 0.1, 
(c) 77 = 0.13, (d) 7y = 1.168 and (e) r/ = 0.2. The 
order-disorder transition occurs between phases II 
and III. Both of these phases are characterized by 
spontaneous segregations into bands, but in phase 
III these bands are thinner and are more unstable. 
2010j . 



produced by the related simulations as well (see also 
Sec. 13.21). Such waves ar e also generated by the 
model odvicsek et all 119951 in the large velocity limit 
(see Nagv et al.l 2007 [). where large means that the 
jumps made by the particles between two updates 
are compatible or larger than the interaction radius. 
For these parameter values the trajectories of two 
particles can cross each other without an interaction 
taking place. And, indeed, this is what happens in 
a large number of cases in the motility assay. Some- 
times the filaments align, some other times they sim- 
ply cross each others' trajectories. Furthermore, if in 
the simulational model the parameters are chosen in 



such a way that crossing cannot occur (this limit cor- 
responds to the low velocity case), the waves do not 
show up any more (Schaller, private communication). 

A swarm of identical self-propelled particles inter- 
acting via a harmonic attractive pair potential in two 
dimensions in the presence of nois e was also con- 
sidered. By numerical simulations lErdmann et al. 
found that, if the noise is increased above a 



[200 

certain limit, a transition occurs during which the 
translational motion breaks down and instead of it, 
rotational motion takes shape. 

4.2.2 Models with alignment rule 

Units in every system exhibiting any kind of collec- 
tive motion (or more generally, collective behavior) 
interact with each other. In the original SVM, this 
interaction occurs in the so called "metric" way, that 
is, each unit interacts only with those particles which 
are closer than a pre-defined distance, called "range 
of interaction". An alternative to this approach is 
the "topological" representation, in which each par- 
ticle communicates with its n closest neighbour (a 
typical value for n is around 6-7.) These approaches 
are closely related, since by varying the range of in- 
teraction (or if it is set to be unit, as in most cases, 
then by varying the particle density) the number of 
the nearest neighbours, with whom a unit communi- 
cates, can be - at least in average - adjusted. The 
important difference here is that since in the met- 
ric approach the density can be prescribed, thus, the 
number of the particles falling in the range of inter- 
action might cha nge as well. There is a r eoccurring 
subtle point here. Ginelli and Chate 2Q10| compared 
the two approaches and pointed out the main differ- 
ence, because in the topological distance model they 
obtain a second order phase transition to order, while 
they claim that in the SVM model the nature of the 
transition is of first order. We have discussed this 
point in Sec. 14.1.11 and argued that the resolution 
for the controversy lies in the very specific feature of 
the SVM, i.e., in the metric model for low velocities 
the transition is continuous (like in the topological 
model) , while for large velocities it is of first order 



(see [Nagv et al.l . 1200 



Compared to the original SVM, an important addi- 
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Figure 38: (Color online) The SVM augmented with 
cohesive interactions among the particles. A snap- 
shot of a flock consisting o f 16,384 part i cles, m oving 



'cohesively'. Adapted from lChate et al.l [2008a |. 



tional feature has been introduced bv iGregoire et al, 
|2003l | who added adhesion between the particles to 
avoid "evaporation" of isolated clusters in simula- 
tions with open boundary conditions. Adding this 
new feature has changed the universality class (order 
of transition) and the observed ordering was discon- 
tinuous as a function of perturbations. 

The most common way to introduce cohesion to 
a system without resorting to global interactions, 
is to complement the interaction rules defining the 
units' behavior with some kind of pairwis e attraction- 

this spirit, IChate et al. 



In 



rep ulsion mechanism 
|2008aj have added a new term to Eq. ((13]), which 
determines a pairwise attraction-repulsion force be- 
tween the particles (See Fig. [38| . 

Another g enera lization has been considered by 
;ab6 et al. 2009l |. By extending the factors in- 
fluencing the ordering, the model assumes that 
the velocity of the particles depends both on the 
velocity and the acceleration of neighboring parti- 
cles. (Recall, that in the original model it depends 
solely on the velocity). Changing the value of a 
weight parameter determining the relative influence 
of the velocity and acceleration terms, the system 
undergoes a kinetic phase transition. Below a critical 
value the system exhibits disordered motion, while 
above the critical value the dynamics resembles that 



Figure 39: (Color online) A snapshot of the sim- 
ulations with point-like particles, but su bject to a 
nemati c-type interaction, performed by iChate et al.l 
(2008al | . The behavior of the system is qualitatively 
different from those with isotropic particles and ex- 
hibits characteristic density and velocity fluctuations. 
Color code refers to the local denseness from blue 
(low density ) to yellow (high density) . Adapted from 



Chate et al.l 2008a l 



of the original SPP model. 

One might interpret the particles of the SVM as po- 
lar u nits, since they car ry a velocity vector. Accord- 
ingly, IChate et al.l |2006l | consider a bipolar version of 
the SVM, in which after the angle corresponding to 
the local average velocity is determined, the particles 
can 'decide' whether they move along this direction 
or in a direction opposite to it. Such a model arises 
from the consideration of the self-propelled motion 
of elongated particles preferably moving along their 
main axis. The authors flnd a distinctively differ- 
ent disorder-order transition involving giant density 
fluctuations (GNF), compar ed to the previously con- 



sidered cases. According to IChate et al.l |2008aj . the 
expression {iJj{t))g appearing in the interaction rule 
of the SVM (Eq. (|13l) ) - expression which is in close 
relation to the local order parameter around parti- 
cle i in its neighborhood S - can be replaced by the 
eigenvector of the largest eigenvalue belonging to the 
nematic tensor calculated on the same neighborhood. 
Denoting the angle defining the direction of Vj by 9j , 
this eigenvalue, which is also directly related to the 
local order parameter, for uniaxial nematics in two 
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space dimensions is calculated as | {exp{2i9j{t))) g \. 
j denotes those particles that are within the neigh- 
borhood S of particle i, Si, at time-step t. Since each 
particle i chooses the direction defined by 9i or the 
opposite direction 9i + n with the same probability 
1/2, Eq. ([HI) gets the form 

Xi{t + 1) = Xi{t) ± Vi{t + 1) 

A snapshot of the resulting collective motion pat- 
tern can be seen in Fig. [39l 

By using a novel set of diagno stic tools related to 



the pa rticles' spatial distribution iHuepe and Aldana 



2008| compared three simple models qualitatively 



reproducing the emergent behavior of various ani- 
mal swarms. The most important aim of introduc- 
ing the above measures is to unveil previously un- 
reported qualitative differences and characteristics 
(which were unclear) among the various models in 
question. Comparing only the standard order pa- 
rameters (measuring the degree of alignment), the 
authors find very similar order-disorder phase transi- 
tions in the investigated models, as a function of the 
noise. They demonstrated that the distribution of 
cluster sizes is typically exponential at high noise- 
values, approaches a power-law distribution at re- 
duced noise levels, and interestingly, that this trend 
is sometimes reversed near to the critical noise value, 
s uggesting a non-triv i al cri tical behavior. 

Smith and Martini 2009l | used a Lagrangian indi- 



vidual based model with open boundary conditions to 
show that the Morse and the Lennard- Jones poten- 
tials (coupled with an alignment potential) are also 
capable to describe many aspects of flocking behav- 
ior. 

With the accumulation of experimental data and 
modeling results within this field, it is becoming more 
and more clear that very simple local interaction rules 
can produce a huge variety of patterns within the 
same system in a way that the type of the emerg- 
ing pa ttern depends o nly o n a few parameters. Re- 



cently IPeruani et al. 2011 1 recorded various kinds 



of self-organized spatial patterns by using a simple 
model: a two-dimensional lattice with volume exclu- 
sion. In a lattice, "volume exclusion" means that 
a node could be occupied by at most one particle. 




Figure 40: (Color online) As the particles in the 
model exhibit an increasing tendency to align, dif- 
ferent pattern arise: (a) orientational disorder, while 
particles self-segregate, (b) traffic jam, (c) glider, and 
(d) band. The colors code the four possible orienta- 
tion: red is for 'right', 'left' is depicted with black 
color, gree n marks 'down', and 'up' is coded with 
blue. From lPeruani et al.l 2011 j. 



and also the rotational symmetry is broken which 
otherwise characterizes all models assuming contin- 
uum spatial dimensions. The units had the tendency 
to align 'ferromagnetically'. As the susceptibility of 
the particles to align to their neighbors increased, 
the system went through some distinct phases (see 
Fig. l40l) : first, for weak alignment strength the units 
self-segregated into disordered aggregates (Fig. HUk). 
which then, by strengthening the alignment, turns 
into locally ordered, high density regions, which the 
authors caU "traffic jams" (Fig. l40b). By further 
enhancing the susceptibility of alignment, triangu- 
lar high density aggregates emerge (called "gliders" ) 
that migrate in a well-defined direction (Fig. l40bV 
Finally, these structures self-organize into highly- 
ordered, elongated high density regions: bands (Fig. 

SDH). 

4.3 Continuous media and mean-field 
approaches 

Self-propelled particles, during their motion, con- 
sume energy and dissipate it in the media they move 
in, meanwhile performing rich collective behavior at 
large scales. Recent studies devoted to deriving hy- 
drodynamic equations for specific microscopic mod- 
els have led to new ideas and approaches within this 
field. 

The continuous media approaches to collective mo- 
tion have been carried out, on one hand, in the con- 
text of giving a macroscopic description of SPP sys- 
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tems, however, at the same time, also to interpret the 
so called "active matter" systems associated mainly 
with applications from physics, such as active nemat- 
ics and active suspensions. 

The first theory describing the full nonlinear 
higher dimensional dyna mics was presented in 
Toner and Il995i llQQSl. Tu and Toner f ollowed 



the historical precedent [Forster et all , Il977l | of the 



Navier-Stokes equation by deriving the continuum, 
long-wavelength description not by explicitly coarse 
graining the microscopic dynamics, but, rather, by 
writing down the most general continuum equations 
of motion for the velocity field v and density p con- 
sistent with the symmetries and conservation laws of 
the problem. This approach allows to introduce a 
few phenomenological parameters (like the viscosity 
in the Navier-Stokes equation), whose numerical val- 
ues will depend on the detailed microscopic behavior 
of the particles. The terms in the equations describ- 
ing the large-scale behavior, however, should depend 
only on symmetries and conservation laws, and not 
on the microscopic rules. 

The only symmetry of the system is rotation invari- 
ance: since the particles lack a compass, all direction 
of space are equivalent to other directions. Thus, 
the "hydrodynamic" equation of motion cannot have 
built into it any special direction picked a priori; all 
directions must be spontaneously selected. Note that 
the model does not have Galilean invariance: chang- 
ing the velocities of all the particles by some constant 
boost Uf, does not leave the model invariant. 

To reduce the complexity of the equations of mo- 
tion still further, a spatial-temporal gradient expan- 
sion can be performed keeping only the lowest order 
terms in gradients and time derivatives of i7 and p. 
This is motivated and justified by the aim to con- 
sider only the long distance, long time properties of 
the system. The resulting equations are 

dtv + Xi{vV)v + A2(Vw)?; + AgVdwp) = 

av-l3\v\^v-\/P+DL'^{S/v)+DiS/^v+D2{vS/)^v+£^ 

(24) 

(25) 



In Eq. (|24l) . the terms a,/3 > give v a nonzero 
magnitude, -Dl, 1,2 are diffusion constants and ^ is an 
uncorrelated Gaussian random noise. The A terms on 
the left hand side of the equation are the analogs of 
the usual convective derivative of the coarse-grained 
velocity field u in the Navier-Stokes equation. Here 
the absence of Galilean invariance allows all three 
combinations of one spatial gradient and two veloci- 
ties that transform like vectors; if Galilean invariance 
did hold, it would force A2 = A3 = and Ai = 1. 
However, Galilean invariance does not hold, and so 
all three coefficients can be non-zero phenomenolog- 
ical parameters whose values are determined by the 
microscopic rules. Eq. ((25|) reflects the conservation 
of mass (birds). The pressure P depends on the local 
density only, as given by the expansion 



P = P{p) = J2<^nip-poy 



(26) 



where po is the mean of the local number density and 
cr„ is a coefficient in the pressure expansion. 

It is possible to treat the whole problem analyt- 
ically using dynamical renormalization group and 
show the existence of an ordered phase in 2D, 
and extract exponents characterizing the velocity- 
velocity and density -density correlation functions 
Toner and fi] . [ 19981. The most dramatic result is 



and 



dtp + S/ipv) = 0. 



that an intrinsically non-equilibrium and nonlinear 
feature, namely, convection, suppresses fluctuations 
of the velocity v at long wavelengths, making them 
much smaller than the analogous fluctuations found 
in ferromagnets, for all spatial dimensions c? < 4. 
In other words, the existence of the convective term 
makes the dynamics "non-potential" and further sta- 
bilizes the ordered phase. Heuristically, this term 
accounts for the stabilization effect resulting from 
the feature that the actual neighbours of each unit 
continually change due to the local differences in 
the direction. Thus, particles (birds) which initially 
were not neighbours, and thus did not interact with 
each other, at a later time-step might be within each 
other's interaction range. 

Further predictions of the above model were tested 
by numerically studying a discrete model very sim- 
ilar to the SVM. Compared to the original model. 
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an extra interaction term was introduced, in order to 
prevent cluster formation; 



9^J = 90 in - rj) I ( ^) - 



(27) 



This expression sets the average distance between 
boids in the flock to be Iq by creating an attraction 
force between particles i and j if the rij distance be- 
tween them is bigger than than Iq , and making them 
repel each other if Tij < Iq- go is a model param- 
eter, defining the strength of the above mentioned 
attraction-repulsive force. The linear size L of the 
simulated system was L = 400 with N = 320,000 
boids moving in it. The range of interaction was set 
to be unit (1), go = 0.6, the velocity vq = 1.0 and 
lo = 0.707. In finite size systems, the average direc- 
tion of the flock < V > slowly changes in time, due 
to the noise. In contrast, analytic results assume in- 
finite systems size in which the direction < v > is 
constant. In order to handle this disagreement, the 
boundary condition in one direction (say the x) was 
set to be periodic, while in the other (the y) a re- 
flective boundary condition was applied. Hence, the 
symmetry broken velocity was forced to lie along the 
X direction. As an interesting phenomenon, in the 
direction y (the one perpendicular to < w >) the in- 
dividual boids exhibit an anomalous diffusion. Fur- 
thermore, as an even more surprising result, in the 
flock's moving direction (x), the fluctuations of the 
velocity and the that of the density were propagating 

w ith different velocity . 

iBertin et al.l |200a l2009t made a very important 
step towards a fundamental theory of collective mo- 
tion by deriving the hydrodynamic equations for the 
density and velocity fields of a gas of self-propelled 
particles with binary interactions from the corre- 
sponding microscopic rules. They gave explicit ex- 
pressions for the transport coefficients as a function 
of the microscopic parameters. Comparison with 
numerical simulations on a standard model of self- 
propelled particles (SVM, see Sec. 14. ip resulted in 
an agreement as well as in a demonstration of the 
robustness of the phase diagram they obtained. Iihi3 



for all transport coefficients as a function of the three 
main parameters, noise, density and velocity. 

Over the last 4 years, the hydrodynamic equations 
became increasingly precise by including higher order 
terms and more pr ecise coefficients. Very recently 
iMishra et al. 2010| solved the equations describing 
the collective motion of self-propelled polar rods mov- 
ing on an inert substrate. From their theoretical con- 
siderations and numerical analysis, the authors ob- 
tained a remarkable phase diagram for this system 
(Fig. mi). They showed that the same physics that 
leads to global ordering destabilizes the homogeneous 
ordered state above a critical value of self-propulsion 
speed and allows the nonlinear equations to admit 
a propagating front solution that yields the striped 
phase identified numerically. The two phases they 
observed, namely, the striped phase and the fluctu- 
ating flocking phase, have been identified earlier in 
the context of numeri cal studies of t he SV M model, 
thus, the approach of Mishra et al. 2010l | identified 



the origin of these phenomena in the model indepen- 
dent framework of the dynamics of conserved quan- 
tities and broken symmetry variable. 

It is important to point out th a t the above 
mentioned equatio ns [Bertin et al. , l2009l 120061 



Mishra et al.l l2010l | obtained as a result of detailed 



derivations based on microscopic dynamics have an 
analogous structure and contain the same major 
terms as the ones (Eqs. [24land[25|) proposed by Toner 
and Tu inspired by general considerations. 

A further important approach involving contin- 
uum mechanics is based on considering the hydro- 
dynamic properties of systems consisting of micro- 
scopic swimmers fse e also Sec. 15.1.11). By develor 



^ lop - 

ing a kinetic theory, ISaintilla n and Shellev 2008bl |a 
and Saintillan and S hellev [20083] b studied the col- 



lective dynamics and pattern formation in suspen- 
sions of self-propelled particles. They investigated 
the stability both of aligned and isotropic sus- 
pensions, and - by generalizi ng the predictions of 



Simha and Ramaswamvl |2002l | - they showed that 



201 ij showed how to explicitly coarse grain the mi- 



croscopic dynamics of the SVM to obtain expressions 



aligned suspensions of self-propelled particles are al- 
ways unstable to fluctuations. Furthermore, they 
showed that in the case of initially isotropic suspen- 
sions an instability for the particle stress takes place 
for pushers - particles propelled from the rear - but 
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Figure 41: (Color online) (A) Phase diagram of the 
solutions of the Eqs. (|24p and (|25l) in the (wo,Po) 
plane. At = the system exhibits a continuous 
mean-field transition at po = Pc from an isotropic (I) 
to a homogeneous polarized (HP) state. For po > pc 
there is a critical Wc(po) separating a polarized mov- 
ing state with large anomalous fluctuations, named 
the fluctuating flocking state, at low self-propulsion 
speed from a high-speed phase of traveling stripes. 
The circles denote the values of Wc(po) obtained nu- 
merically. The dashed-dotted line (purple online) 
is the longitudinal instability boundary w^i(po) ob- 
tained in the calculations. The dashed line is the 
splay instability boundary v^{pa). (B) shows a snap- 
shot of the density proflle in the striped phase. The 
stripes travel horizontally. (C) shows a snapshot of 
the density profile in the coarsening transient leading 
to the fluctuating flocking state at vq < Vc- Density 
values grow from dark to light. After iMishra et al, 
2010j . 




Figure 42: (Color online) Snapshots of the simula- 
tions performed to study the long-time dynamics and 
pattern formation of suspensions of pushers. The left 
column shows the concentration field c and the right 
column depicts the mean director field n at three dif- 
ferent times: (a) t = 0, (b) t = 60 and (c) t = 85. 

g3 |2008bt a. 



From Saintillan and Shelle'v 



not for pullers. 

Figure l42l shows three snapshots of the simulations 
they performed in order to study the long-time dy- 
namics and pattern formation of suspensions of push- 
ers. The left column shows the concentration field 
c, and the right column depicts the mean director 
field n at various times. The instability develops at 
t = 60, when short-scale fluctuations disappear and a 
smooth director fleld appears with correlated orienta- 
tions over the size of the box. The dense regions that 
can be observed on Fig. |42] (b) typically form bands, 
and as time passes by, they become unstable and fold 
onto themselves, the bands break up and reorganizes 
in the transverse direction. These dynamics repeat 
quasi-periodically. 

Starting with a simple physical model of in- 
teracting active particles (swimmers) in a fluid. 
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The dynamics of a swimming particle a is given by 




Figure 43: (Color online) The simplified physical 
model of the active self-propelle d parti cles in the pa- 
per of Baskaran and Marchetti 2009l | are basically 
asymmetric rigid dumbbells. Two different size of 
spheres {S and L) are connected with an infinitely 
rigid rod having a length I. The radii of the smaller 
and larger spheres are as and respectively. The 
geometrical midpoint of the swimmer is depicted by 
M, while the hydrodynamic center is marked with C, 
at which the propulsion is centered. The orientation 
of these asymmetric particles are characterized by a 
unit vector v. \f\ denotes the force they exert on 
the fiuid they swim in. With this notation, pullers 
correspond to / < and pus hers to / > 0. From 
Baskaran and Marchetti 2009| . 



Baskaran and Marchetti 2009j | derived a continuum 
description of the large-scale behavior of such ac- 
tive suspensions. They differentiated "shakers" from 
"movers" . Both of them are active, but a mover, in 
contrast with a shaker, is self propelled. Shakers are 
also active, but they do not move themselves. Fur- 
thermore "pushers" are propelled from the rear (like 
most bacteria), while "pullers" are propelled by fiag- 
ella at the head of the organism. 

The simplified physical model of a swimmer is ba- 
sically an asymmetric rigid dumbbell, as depicted in 
Fig. |43l Each of these units has a length I, and 
their orientation is characterized by a unit vector i>, 
directed along its axis from the small sphere (hav- 
ing radius as) to the large sphere (having radius a^). 
They exert a force dipole of strength |/| on the fiuid 
they swim in, which has a viscosity fj. The velocity 
of the particles are vsp = vqv. 



dtTLa = u{rLa), 

dtrsa = u{fsa), 



(28) 



where rsa and f^a denote the position of the small 
and large "heads" of swimmer a, respectively, with 
respects to a fixed pole. u{r) is the fiow velocity of the 
fiuid at point r which is determined by the solution 
of the Stokes equation, that is. 



fjV^uif) ^Vp- Fa 



(29) 



where Fnoise describes the effect of the fiuid- 
fiuctuations, and FacUve is the active force exerted 
by swimmer a on the fiuid. 

Closed formulas can be obtained for the transla- 
tional and rotational motion, and for the hydrody- 
namical force an d the torque between two swimming 
particles as well. Baskaran and Marchetti 2008| ana- 
lyzed a simple model that captured two crucial prop- 
erties of self-propelled systems: the orientable shape 
of the particles and the self propulsion. Using the 
tools of non-equilibrium statistical mechanics they 
derived a modified Smoluchowski equation for SPP 
and used it to identify the microscopic origin of sev- 
er al observed or observable large scale phenomena. 

Peruani et al.l 2008| suggested a mean-field theory 



for self-propelled particles which accounted for fer- 
romagnetic (F) and liquid-crystal (LC) alignment. 
The approach predicted a continuous phase transi- 
tion with the order parameter scaling with an expo- 
nent of 1/2 in both cases. The critical noise ampli- 
tude below which orientational order emerges found 
to be smaller for LC-align ment than for F-alignment. 
ICsahok and Czirdk 1997 1 presented a hydrodynamic 
approach to describe the motion of migrating bacte- 
ria as a special class of SPP systems. 

As a novel applic a tion o f the hydrodynamic equa- 



tions, lAlicea et al.l |20Q5l | used this approach in 



order to describe a recently observed electromag- 
netic phenomenon . A ccording to the o bserva- 

tions ( jMani et all . l2002i IZudov et all |20Q3| ) high- 
mobility two-dimensional electron systems subject to 
a perpendicular magnetic field exhibit zero-resistance 
states, when driven with microwave radiation. By 
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studying the transition from normal state (with non- 
zero resistance) to the zero-resistance phase, the au- 
thors find analogy with "flocking" systems. In partic- 
ular, the two frames become identical in the limit of 
zero magnetic field and short range electron-electron 
interactions. 

The equations of motion for the current and den- 
sity fluctuations are constructed based on symmetries 
and conservation laws. Two cases were analyzed: a 
model valid for small length scales (on which the den- 
sity does not vary noticeably) characterized by an im- 
posed symmetry under a global uniform shift of the 
density, and a description argued to be appropriate 
for describing the system on long length scales. In 
the first case, the type of the phase transition is pre- 
dicted to be continuous in case of short-range inter- 
actions and first order otherwise (long-range), while 
the second model predicts first order phase transition 
in both cases. 

This is a quickly gro wing field of its own has re- 
cently been reviewed by iLauga and Power^ 2009| | . 



4.4 Exact results 

By exact results here we mean results obtained 
with a minimum or completely missing amount of 
any kind of assumptions or approximations concern- 
ing the behavior of the moving units (beyond the 
rules/definitions they obey). Originally most results 
in this area were obtained only for systems in which 
the noise (an otherwise essential aspect of fiocking) 
was completely neglected. Thus, one could consider 
the related systems as fully deterministic. However, 
it has recently been shown (see later) that the the- 
orems we review below are in most cases valid for 
systems with a low level of perturbations as well. 

4.4.1 The Cucker-Smale model 

An exact formulation of the convergence to con- 
sensus in a po pulation of auton o mous agents 
was achieved by Cucker and Smale 2007al |a and 
ICucker and Smale |2007bl |b based on their model 
(CS). Following their train of thought, let us consider 
birds, denoted by i = 1, . . . , fc, moving in 3 dimen- 
sional (Euclidean) space, 3?'^, endeavoring to reach a 



common direction - which is in this case the topic of 
"consensus" . The position of the ith bird is given by 
Xi{& di^). (Of course, Xi — Xi{t).) Let us define the 
adjacency matrix A — {aij), where the element aij 
measures the ability of birds i and j to communicate 
with each other, or one could say, the influence they 
exert on each other. The elements of A should take 
values from the interval (0...1], and the closer unit 
i is to unit j, the bigger aij should be (since they 
influence each other stronger). /? is a "tuning pa- 
rameter" , effecting the strength of the influence. An 
appropriate expression for the above requirements is 



1 



(1 



(30) 



where /3 > (not to be confused with the critical ex- 
ponent introduced in Sec. 12. ip . The main advantage 
of this form of the distance dependence of the interac- 
tion is that it is a smooth function allowing analyt- 
ical treatment. Importantly, this adjacency matrix 
A changes with time, since the positions of the birds 
change with time. 

For the more manifest usage of graphs the authors 
introduce the Laplacian matrix of A as well, L = 
D ~ A, where D is a k x k diagonal matrix whose ith 
diagonal element is defined as di = J2'j=i^ij- The 
Laplacian matrix - a form by which a graph can be 
represented in matrix-form - is often used to find 
various properties of a graph. In particular, as we will 
see, the eigenvalues of L bear important information. 

Denoting the velocity of bird i at time t by Vi{t){G 
5i^), 



Vi{t + h) ~ Vi{t) 



h ai 



[vj - V,) (31) 



Recall, that the a,y value measures the strength of 
the communication between birds i and j, thus the 
right hand side of Eq. (j3ip signifies a local averaging 
around bird i. 

The equations of flocking are obtained by letting h 
tend to zero: 



X — V 

v' — ~Lv 



(32) 
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on (3?^)'^ X (3?^)'^, where L gives the local averaging. 
(Note that the matrices A and L are acting on (3?'^)'^ 
by mapping {vi, Vk) to {anVi + . . . + aikVk)i<k-) 

After the above preparations, one can ask that 
under what conditions does a system (described by 
the above equations) exhibit flocking behavior? Or in 
other words, when do the solutions of Vi(t) converge 
to a common v*{g 3?^)? 

One of the most important results of 
Cucker and SmaDi \2007d] a is that the emer- 
gence of the flocking behavior depends on /S; namely 
if (3 is small enough (j3 < 1/2) then flocking always 
emerges. Formally, 

Theorem: For the equations of flocking (Eqs. [32]) 
there exists a unique solution for alH S 3?. 

If /3 < 1/2 then the velocities Vi{t) tend to a com- 
mon limit t;*(e 3?'^) as i — > oo, where v* is indepen- 
dent of i, and the vectors Xi — xj tend to a limit-vector 
Xij for all i, j < k, as t ^ oo, that is, the relative po- 
sitions remain bounded. 

If /3 > 1/2 dispersal, the split- up of the flock is 
possible. But, provided that some certain initial 
conditions are satisfied, flocking will occur. 

To obtain more general results for the conditions 
of flocking, one can investigate the eigenvalues of the 
corresponding Laplacian matrix L. Let G denote a 
graph and A be the corresponding adjacency matrix 
defined as usually, that is, 



1 if z and j are connected, 
~ ^ if not 



(33) 



Let D be a diagonal matrix with the same dimensions 
as A, defined by d{i, i) = a{i,j). Then the general 
form of the Laplacian matrix of G, is given as L = 
L{G) = D — A. The eigenvalues of L can be expressed 
by 

= Ai < A2 < A3 < . . . (34) 

Ai, the first eigenvalue is always zero. The second 
one in ascending order, A2, is the so-called Fiedler- 
number, F, which is zero if the graph G is separated 
(in this case the flock disintegrates to two or more 
smaller flocks), and non-zero if and only if G is con- 
nected. This number is a crucial descriptive measure 



of the conditions needed to be satisfied for the emer- 
gence of flocking. 

Importantly, in the case of flocking, F = F{t) (it 
is a function of time), because the elements of G de- 
pend on the Xi positions of the individual birds. By 
using the Fiedler-number, we can say that one ob- 
tains flocking, if and only if 



< const < F ^ F{x{t)). 



(35) 



Otherwise the flock disperses. 

The above definitions can be extended to weighted, 
general matrices as well. 



In addition, Cucker and Pond 201C| extended the 
model by adding to it a repelling force between par- 
ticles. They showed that, for this modified model, 
convergence to flocking is established along the same 
lines while, in addition, avoidance of collisions (i.e., 
the respect of a minimal distance between particles) 
is ensured. 

The main differences between the systems de- 
scribed by Cucker and Smale and by the SVM are, 
from the one hand, the definition of the range of in- 
teraction, and from the other hand, the existence (or 
absence) of noise. The SVM comprises noise, while 
the original Cucker-Smale model does not. Regard- 
ing the range of interaction, in the present model it is 
a long-range effect decaying with the distance accord- 
ing to 13 (see Eq. while in the SVM it has the 
same intensity for all the neighboring units around a 
given particle, but only within a well-defined range 
(see Eq. (fT3l)). 

Very recently perturbations have also been consid- 
ered in the CS model. This has been done with var - 
ious fo r ms of noise by ICucker and Mordecki 2008j | , 
Shane |2009l |. modeled with stochastic differential 
equations by iHa et al.l [2009l |. and taking into ac- 
co unt random failures between agent's connections 
bv lDalmao and Mordedcil |2009{ . 

Other works developing the Cucker-Smale (CS) 
model in several directions iiiclude an extension to 
fluid-like swarms iHa and Liul . l2009l lH a and Tadmoii 



20Q8LICarrillo et al.Ll2010lT collision avoiding flocking 
Cucker and Donell2010l| " the incl usion of agents with 



a preferred velocity direction Cucker and Huep3 . 
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2008l | , and its proposal as a control law for the space- 



crafts of the Darwin missi on of the European Space 
Agency |Perea et all l2009l | . 



4.4.2 Network and control theoretical as- 
pects 

Networks have recently been proposed to repre- 
sent a useful approach to the interpretation of 
the intricate underlying structure of connections 
among the elements of complex systems. A 
number of important features of such ne t works 
have been uncovered Albert and Barabasil 2002 , 
Watts and Strogat^ . 1998j |. It has been shown that 
in many complex systems ranging from the set of 
protein interactions to the collaboration of scientists 
the distribution of the number of connections is de- 
scribed by a power law as opposed to a previously 
supposed Poissonian. Most of the networks in life and 
technology are dynamically changing and are highly 
structured. In particular, such networks are typically 
made of modules that are relatively more densely con- 
nected part s within the enti r e network (e.g., in t eract- |2006l| found the existence of spanning trees to be 



spite the absence of centralized coordination and de- 
spite the fact that each agent's set of nearest neigh- 
bors changes in time. By addressing the question of 
global ordering in models analogous to Eqs. (fT3|) and 
(fT5|) they presented some rigorous conditions for the 
graph of interactions needed for arriving at a consen- 
sus. 

Several further control theory inspired papers dis- 
cussed both the question of convergence of the 
simplest SPP models as well as the close re- 
lation of flocking to such alternative problems 
as consens us finding, synchronization and "goss ip 
al gorithms" iBlondel et al.l l2005l iBovd et al.l . l2005| . 
Ren and BeardI [2005j | considered the problem of 



consensus finding under the conditions of limited 
and unreliable information exchange for both discrete 
and continuous update schemes. They found that 
in systems with dynamic interaction-topologies con- 
sensus can be reached asymptotically, if the union 
of the directed communication network across some 
time intervals has spanning trees fre quently enough 



as th e system evolves. Similarly, IXiao and Wane 



ing flocksl iNewmanl . I2004L l2006l IPalla et all . l2005l . 
Scottl . l2000l |. The evolution of these modules plays a 
central role i n the behavior of the system as a whole 



IPalla et al.. 2007 



In these terms, a dynamically changing network 
can be associated with a flock of collectively moving 
organisms (or robots, agents, units, dynamic systems, 
etc.). In such a network two units are connected if 
they interact. Obviously, if two units are closer in 
space have a better chance to influence the motion of 
each other, but their interaction can also be disabled 
by environment or internal disturbances. Since the 
units arc moving and the environment is also chang- 
ing, the network of momentarily interacting units is 
evolving in time in a complex way. Using the con- 
ventional terminology of control theory, this kind of 
topology (that is, when certain number of edges are 
added or removed from the graph from time to time), 
is called "switching topol ogy" . 



crucial in the directed graphs representing the inter- 
action topologies, in systems in which the topology, 
weighting factors and time delays are time- invariant. 
They studied the consensus-problem for dynamic net- 
works with bounded time- varying communication de- 
lays under discrete-time updating scheme, based on 
the properties of non-negative matrices. 

An efficient algorithm controlling a flock of un- 
manned aerial vehicles (UAVs) is considered by 
Ben-Asher et al. I [2008]. The units are organized into 



Jadbabaie et al.l |2003l | investigated a theoretical 



explanation for a fundamental aspect of the SVM, 
namely, that by applying the nearest neighbor rule, 
all particles tend to align into the same direction de- 



a minimal set of rooted spanning trees (preserving 
the geographical distances) which can be used for 
both distributed computing and for communication 
as well, in addition to computation and propagation 
of the task assignment commands. The proposed 
protocol continually attempts to keep the number of 
trees minimal by fusing separate adjacent trees into 
single ones: as soon as radio connection between two 
nodes belonging to separate trees occurs, the cor- 
responding networks fuse. This arrangement over- 
comes the typical deficiencies of a centralized solu- 
tion. The motion of the c ertain UAV s is co ordinated 
by Reynolds's algorithm Reynold^ . Il987| (see also 
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S ec. Oil- 



Tanner et al.l |2003al | proposed a control law for 



flocking in free-space. Dynamically changing topol- 
ogy of the interacting units has also been considered 



Tanner et all l2003bl | . iLindhe et all |2005j suggested 



a flocking algorithm providing stable and collision- 
free flocking in envir onments with complex obstacles. 



Holland et al.l [200a | proposed a flocking scheme for 
unmanned ground vehicles similar to Reynolds' algo- 
rithm based on avoidance, flock centering and align- 
ment behaviors, where the units receive the range, 
bearing and velocity information from the base sta- 
tion based on pattern recognition techniques. Very 
recently, many further papers have appeared both on 
the original flocking problem as well as on interest- 
ing variants including the role of "leaders" , delays in 
communication, convergence time, etc. 

One of the most general theoretical frameworks 
for design and analysis of distributed flocki ng algo- 
rithms was discussed by lOlfati -Saben |2006j . Three 
algorithms were investigated in detail: two for free- 
flocking (one fragmented and one not) and one for 
constrained flocking. The basic driving rules and 
principles and their relation to specific underlying 
network structures were discussed. 

Formally, from a control theoretical view-point, the 
problem looks as next: given a set of agents, who 
want to reach a consensus, which, in this terminology, 
means a common value (an "agreement") regarding 
a certain quantity that depends on the state of the 
agents. (For example, this 'certain quantity' can be 
the direction of motion.) The interaction rule that 
defines the information exchange between a unit and 
its neighbors is called the consensus algorithm (or 
"protocol"). 

This system can be represented by a graph G = 
{V,E), in which the agents are the nodes V — 
{1, 2, . . . , n}. Two nodes are connected with an edge 
e e £' if, and only if, they communicate with each 
other. In this case they are neighbors. Accordingly, 
the neighbors of node i are Ni = j G V : € E. 
If the state of the ith agent (regarding the quantity 
of interest) is denoted by Xi, then the agreement is 

Xi = X2 = X3 = . . . ^ Xn- (36) 
Within this framework, reaching a consensus means 



to converge asymptotically to an agreement (defined 
by Eq. 1361) via local communication. 

Let A = (oij) denote the adjacency matrix, which 
defines the communication pattern among the agents: 
if i and j interact with each other, then > 0, oth- 
erwise Qij = 0. Notably, in the case of fiocks A = A{t) 
and G = G(t), that is, they vary with time. Such 
graphs - called dynamic graphs - are useful tools 
for describing the (time-depe ndent) topology of fl ocks 



Olfati-Sabeiil2006( . 



and mobile sensor networks 

Assuming a simple protocol, the state of agent i 
can change according to 



Xiit) = ^ tti 



{Xj{t) - Xi{t)) 



(37) 



which linear system always converges to a collective 
decision, t hat is, it defines a distributed consensus 
algorithm [Olfati- Saber and Murray! [20o3 | . 

In the case of undirected graphs (when Oij = Oji 
for all i,j £ V) the sum of the sate- values does not 
change, that is, Xi — 0. Applying this condition 
for t — and t — oo, 



(38) 



that is, the collective decision (a) is the average of 
the initial state of the nodes. 

In fact, regarding the protocol defined by Eq. 
(1571). a more strict statem ent can also be formulated 



(Olfati-Saber et al.Ll2007f : 



Lemma: Let G be a connected undirected graph. 
Then, the algorithm defined by Eq. ([37| asymptoti- 
cally solves an average-consensus problem for all ini- 
tial states. 



4.5 Relation to collective robotics 

The collective robotics literature is on the one hand 
about mathematical questions concerning the con- 
trol theoretical aspects of coherently moving devices 
whereas, on the other hand, it represents important 
efforts to eventually produce and describe the collec- 
tive patterns of behavior of a collection (ranging from 
5 to a few dozen) of robots moving on a plane surface. 
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Experimental attempts to produce flocking of aerial 
devices have been very limited. 

In one of the earliest attempts to wards obtaining 
flocking in a group of actual robots, Matarid |l994 | 
combined a set of "basic behaviors"; namely safe- 
wandering, aggregation, dispersion and homing. In 
this study, the robots were able to sense the obstacles 
in the environment, localize themselves with respect 
to a set of stationary beacons and broadcast the po- 
sition information to the other robots in the group. 
Kellv and KeatinsJ |1996l | used a group of ten robots, 
which were able to sense the obstacles around them 
through ultrasound sensors, and the relative range 
and bearing of neighboring robots through the use 
of a custom-made active infra-red (IR) system. The 
proximity sensors on most mobile robots (such as ul- 
trasound and IR-based systems) can sense only the 
range to the closest point of a neighboring robot and 
multiple range-readings can be returne d from a close 



neighb oring robot. Furthermore, as iTurgut et al, 
j2008l | pointed out, the sensing of bearing, velocity 
and orientation of neighboring robots is still difficult 
with off-the-shelf sensors available on robots. Hence, 
there exist a major gap between the studies that pro- 
pose flocking behaviors and robotics. 

An interesti ng experiment on flo cking in 3D was 
carried out by IWelsbv et all (200 1| using motorized 
balloon-like objects. The slow coherent wondering of 
3 of the robots was observed. Model (toy) helicopters 
were also proposed to observe flo cking in three dimen- 



Nardi and Holland! . l2006l| 



sions 

Several major efforts have been documented about 
the collective exploration of swarms of robots. A va- 
riety of algorithms have been published about the op- 
timal strategy to locate a given object or uncover the 
details of an area (in which the robots could move) 
having a complex shape. Recent papers have demon- 
strated that, using an appropriate algorithm, such 
tasks can be achieved effectively. The largest collec- 
tion of swarming robots has now over 100 miniature 
d evices (http://www. swarmrobot . org/). 



Turgut et al 



|2008j examined the spatial self or- 
ganization properties of robot swarms using mobile 
units (called "Kobots", see Fig. |44|) . Every unit 
were equipped with a digital compass, an infrared- 
based short range sensing system (capable of measur- 




Figure 44: (Color online) A photo of seven mobile 
robots (called "Kobots" ) m oving in a swarm. Accord- 
ing to Turgut et al.l [2008 1. the main factor defining 
the size of the swarm (the number of Kobots flock- 
ing together) is the range of communication, and it is 
highly independent from both the noise (encumbering 
the sensing systems) and from the nu mber of neigh- 
bors each robot had. Adapted from iTurgut et al.l 
[2008,1. 



ing the distance from obstacles and detecting other 
robots) and an other appliance sensing the relative 
direction of the neighboring units. The group inves- 
tigated the behavior of the flock in the function of: 
(1) the amount and nature of the noise encumbering 
the sensing systems (2) the number of neighbors each 
unit had, and (3) the range of the communication. 
They found that the main factor defining the size of 
the swarm (number of units that can flock together) 
is the range of communication, and that this size is 
highly robust against the other two parameters. The 
motion of such robot swarms can be influenced by 
externally guidin g some of their members tow ards a 



desired direction Celikkanat and Sahin . 2010l |. 



Only a few examples are known about trying to 
combine robots and animals into a single system and 
monitor the joint behavior. In a beautiful paper 



Hallov et al.l |2007| investigated whether the behav- 



ior of a population of cockroaches can be influenced 
by micro-robots imitating cockroaches (these micro- 
robots had about the same size and had the same 
odor than the cockroaches). It turned out that it was 
possible to increase the number of cockroaches hid- 
ing under a given "shelter" if the mini-robots were 
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moving there upon switching on the light. 



In a more theoretical work, ISugawara et al. 
investigated the formations of motile elements 
(robots) as a function of various control parameters. 
Their kinetic model - inspired by living creatures, 
such as birds, fishes, etc. - is defined by Eqs. (p9| 
and (l40ll. 



dvi 
I—— 
dt 



0!ij fij 



(39) 



dt 



e^) + Y,J^JS^n{e,-ei), (40) 



where Vi is the position, Vi is the velocity, and fii is 
the heading unit vector of the ith element of a swarm 
consisting of N units [i e 1,2,..., iV), respectively. 
The velocity Vi is relative to the medium (air, fluid, 
etc.) in which the motion occurs. The last quantity, 
fii is parallel to the axis of unit i, but not necessarily 
parallel to its velocity iji. For example, bigger birds 
often glide, during which the heading direction fii and 
the velocity Vi encloses an angle, which is assumed to 
disappear within a relaxation time r. In other words, 
T is the time needed to fii and Vi to relax to parallel. 
9i and (pi are the angles between the x axis and the 
vectors fii and Vi^ respectively, m is the mass of the 
elements (of all the elements - apart from the initial 
conditions, every unit is identical in this model), a 
is the motile force acting in the direction of n^, and 
7 is a quantity proportional to the relaxation time in 
velocity. The term denotes a "direction sensibility 
factor" which is introduced to account for the possible 
anisotropy of the interaction. For example, if the 
robots gather information about the motion of their 
mates through vision (that is, with camera), than 
the interaction is strong towards the visual field that 
is covered by the camera, and zero elsewhere. It is 
defined as 



a. 



1 + dcos$, 



(41) 



where $ is the angle enclosed by fii and — , and 
d is the sensitivity control parameter, < d < 1. 



Jij is introduced to account for the observation 



that animals tend to align with each other [Hunteij . 
19661 through an interaction which is supposed to 
decrease in the linear function of distance between 
individuals i and j: 



Ji' 



(42) 



where k is the control parameter and is the pre- 
ferred distance between neighbors. The term gi is a 
force directed towards the center of the group, and fi- 
nally, fij denotes a mutual attractive/repulsive force 
between elements i and j, in ana logy with the inter- 
molecular forces, as suggested bv iBreder 1954 1. 



\rj--ri\\'^ (\fj -r»r ^ 



r-j - ri \ _ rj-'il 



(43) 



where c is the control parameter defining the magni- 
tude of the interaction. 

Using numerical simulations and experiments with 
small mobile robots (called "Khepera" , a popular de- 
vice for such experiments) , the authors observed vari- 
ous formations, depending on the control parameters 
(see Fig. |45]). They classified the observed collective 
motions into four categories: (1) "Marching" . Ob- 
tained when the value of the anisotropy of mutual at- 
traction is kept small. This state exhibits only small 
velocity-fluctuations and it is stable against distur- 
bance. (Fig. |45] a) (2) The category called "Oscilla- 
tion" includes motions exhibiting regular oscillations, 
such as the wavy motion of the swarm, along its lin- 
ear trajectory, depicted on Fig. 21] h. The stability 
of this state is weaker than that of the marching, 
and these two phases (1 and 2) may coexist for some 
parameters. (3) "Wandering" . When c? 7^ (see 
Eq. (|41]l ). the mutual positions of the units abruptly 
vary, according to stochastic changes in the direction 
of motion. Such a phase is often exhibited by - for 
example - small non-migratory birds. (Fig. |45] c) 
(4) "Swarming" . Irregularly moving units within a 
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mention a few. Fo r a more engineering v iewpoint of 



Figure 45: Trajectories with various control parame- 
ters, obtained from numerical simulations. The solid 
line shows the center of mass, (a) marching, (b) os- 
cillat ion, (c) wandering, an d (d) swarming. Adapted 



from Sugawara et al. 2007| . 



persistent cluster. The mobility of the entire clus- 
ter is small. For example mosquitoes travel in such 
swarms. (See Fig. l45l d). 

In general, the point of organizing robots into 
a swarm is to accomplish tasks (preferably with- 
out centralized control), that are too challenging 
for an individual agent. The fields of the possi- 
ble applications are extremely wide, including prac- 
tical applications (such as the localization of haz- 
ardous em i ssion sources in unknown large-scale areas 



Cui et al.l . l2004|. the surveilla nce in hostile or dan- 



gerous places Marshall 2005 1 , the optimization of 



telecommunication networks [Lipperts and Krelleii . 

as well a s theoretical topi cs (like dis- 
crete optimization jPorigo et al. . 1999| or providing 
new heuristics for the Travelin g Salesman Problem 
[Dorigo and Gambardella . 

Furthermore, within these robot swarms, the 
appearance of the most variable forms of collec- 
tive behavior (like co-operative, altruistic, selfish, 
etc.) can be studied as well through various 
genetic algorithms, conditions and tasks. Many 
homepages maintained by research groups work- 
ing on this field contain further information for 
those who are interested (for example Labo- 
ratory of Autonomous Robotics and Artificial 
Life: http://laral.istc.cnr.it/. Laboratory 
of Intelligent Systems: http://lis.epfl.ch/. 
Distributed Robotics Lab of MIT: http:// 
groups . csail . mit . edu/drl/wiki/index . php/, 
or the web-page of the Swarm-bots 
Project: http://www.swarm-bots.org/ and 

http : //www. swarm-robotics . org/ index .php/), to 



the topic, see also [Eberhart et al.l . 12001 1 



5 Modeling actual systems 

5.1 Systems involving physical 
chemical interactions 

5.1.1 The effects of the medium 



and 



In the case of microorganisms swimming in a 
medium, the hydrodynamic effects are often signif- 
icant enough to generate collective motion passively, 
that is, various coherent structures (e.g., clusters, 
vortices, etc.) arise merely as a result of hydrody- 
namic interactions. One of the first general meth- 
ods for computing the hydrodynamic interactions 
among an infinite suspension of particle s under some 
well-d e fined conditions was pres ented bv lBradv et al. 
|l988l |. iBradv and BossisI |l988t . Their method was 
accurate and computationally efficient forming the 
basis of the Stokesian-dynamics simulation method, 
a technique used in order to yield approximate ex- 
pressions for the velocities of hydrodynamically in- 

te racting particles. 

Siniha and Ramaswamyl 2002l |. iHatwalne et al 



2004 | constructed hvdrodvnamic equations for sus 



pensions of SPPs suitable for making testable pre- 
dictions for systems consisting of bacteria, cells with 
motors or artificial machines moving in a fluid. 

Based on similar studies, in particular exper- 
iments on living c ells moving on a solid sur- 



face f [Gruler et all Il999l iKemkemer et all |2000| ) 



a nd studies on ver tically vibrated layers of rods 
f |Neicu et al.l . 1200% further continuous equations 



I [iNeicu et al.l . l/UUJl | l. turtner contmuous eq uations 
were formulated by iRamaswamv et all |200.3| . They 
considered systems of active nematogenic particles 
without total momentum conservation (the momen- 
tum was assumed to being damped by friction with 
the substrate). The two most important predictions 
implied by their results are: (i) Giant number fluctu- 
ations (GNF): the standard deviation in the number 
N of particles is enormous: it scales as N in the entire 
nematic phase for two dimensional systems, which is 
in deep contrast with ^/N (in the limit of — > oo), 
characterizing equilibrium systems being not at the 
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point of continuous phase transition, (ii) for d > 2 
spatial dimensions, the autocorrelation of the parti- 
cle velocity of a tagged element decays with time t as 
despite the absence of a hydrodynamic veloc- 
ity field. Importantly, the above results imply that 
the nematic phases of rod-like powders can not be 
described by equilibrium statistical mechanics. 

Another app roach, the so called slen der-body the- 
ory was used bv lSaintillan and ShellevI [2007] in order 
to numerically study the dynamics and orientational 
order of self-propelled slender rods. This method was 
used to obtain an approximation to the field sur- 
rounding a slender object and to get an estimation 
for the net effect of the field on the body [Coxl . Il970l 
Batchelor , 1970| . They found local nematic ordering 



over short length scales as well having a significant 
impac t on the mean swimming speed. iRose et al 



2009| investigated the role of hydrodynamic interac- 



tions in case of metal rod-like particles in the presence 
of an externally applied electric field, both by simu- 
lations and experiments. In both cases the particles 
were observed to experience repeated pairing interac- 
tions in which they come together axially, approach- 
ing one other with their ends, slide past each other 
until their centers approach, and then push apart. 
Sankararaman and Ramaswamv |2009l | showed that 
polar self-propelled particles were prone to exhibit 
various types of instabilities through the interplay of 
polarity, activity and the existence of a free surface, 
by using a thin-film hydrodynamic model. 

The motion of the fluid generated by the par- 
ticles swimming in it seems to depend strongly 
on the way these orga nis ms propel themselves 



Lauga and Powersl |2009| . lUnderhill et~aLl [2008 1 



simulated pushers (organisms propelled from the 
rear, like most bacteria) and pullers (creatures that 
are propelled at the head of the organism) separately 
to capture the differences in the effects of the forces 
these creatures exert on the fluid while swimming in 
it. Figure H51 shows the scheme of their self-propelled 
swimmers. Each of them consists of two beads con- 
nected by a rod. They propel themselves by a "phan- 
tom flagellum". ("Phantom", because its physical 
appearance is not taken care of, only its effect on the 
swimmer and on the fluid.) It exerts an Ff force on 
bead 1, and —Ff force on the fiuid. Pushers and 




Figure 46: (Color online) The scheme of a pusher 
and the fluid disturbance it causes. Each SPP is rep- 
resented by two spheres connected by a rod. The 
propulsion is provided by a "phantom flagellum" 
( "phantom" , because it is not treated explicitly, only 
through the effect it exerts to the swimming body and 
to the fluid.) The force exerted by this flagellum acts 
at the center of the first sphere. A puller produces the 
same streamlines (dark gray curves) but the arrows 



i )oint in the opposite direction. From lUnderhill et al 
2008} . 



pullers are distinguished by the direction of Ff. if it 
points from bead 1 to bead 2, then it is a pusher, 
and if it points in the opposite direction, then it is a 
puller. The motion of the particles is calculated by 
solving the force balance for each bead, as given by 
Eq. dH: 



Ff + Fhl + Fei + Fei = 0, 



(44) 



where Fd is the force exerted by the rod (connecting 
the two beads), F^i is the hydrodynamic drag force 
and i^ei is the excluded volume force on the bead. 
The force balance defining the motion of bead 2 is 
the same as Eq. but without the Ff flagellum 

force. 



Using this model, lUnderhill et al.l |2008{ observed 



qualitative differences between the effects of push- 
ers and pullers, exerted on the fiuid they move 
in: SPPs that are pushed from the behind show 
greater enhancement than particles that arc pulled 
from the front. This model - supported by 



Mehandia and Notti j2008l | as well - describes the far- 
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field behavior of interacting swimming particles. 

The notion of "squirmer" has also been introduced 
in order to apprehend the most important features 
of swimming micro organism s (with respect to their 
motion in a fluid) [Lighthili 1952 [. These are neu- 
trally buoyant squirming spheres with a tangential 
surface velocity and with anisotropic structures, that 
is, their center of mass and geometric center do not 
n ecessarily coincide. 

Ishikawa and Pedlev |2008{ simulated the motion 



of such squirmers in a monolayer, that is, in two di- 
mensions. In order to do so, they included not only 
the far-field fiuid dynamics, but the near-field compo- 
nents too, which gave the novelty of their approach. 
These simulations demonstrated that various types 
of processes resulting in coherent structures (such 
as aggregation, band formation or mesoscale spatio- 
temporal motion) can be generated by pure hydro- 
dynamic interactions. Accordingly, Fig. |47] shows 
the velocity correlation function among the particles 
lu = Iu{f), as a function of the distance r separating 
the squirmers. Ca is the areal fraction of the parti- 
cles in the monolayer, thus it refers to their sizes: 
bigger Ca denotes larger sphere. However, these sim- 
ulations did not show vigorous coherent structures 
in fully three-dimensional cases, that is, when the 
particles were not res tricted to move on a monolayer 
[ishikawa et al.l 



2008 1 



Subramanian and Koch 2009| examine the stabil- 
ity properties of a bacteria suspension, in which 
the the bacteria execute a "run-and-tumble" motion, 
that is, after swimming in a given direction, the runs 
are interrupted by tumbles, leading to an abrupt mo- 
tion. Due to the features of the force field produced 
by the bacteria, instability is predicted to occur in 
suspensions of pushers. They argue that for speeds 
smaller than a critical value, the destabilizing stress 
remains minor and a dilute suspension of such swim- 
mers responds to long- wavelength perturbations in a 
similar way than suspensions of passive rigid particles 
would respond. 

An interesting example of collective motion is the 
synchronized beating of flagella on the surface of uni- 
cellular, or simple multicellular organisms. It was 
shown that such a coherent motion of flagella leads 
to a highly increased exchange rate of the nutrients 




Figure 47: The velocity correlation function among 
the particles {Ijj) as a function of the distance among 
the units r for three different sphere-sizes. In the 
region r < Q, Ijj is positive, denoting that nearby 
particles tend to swim together in similar direction. 
In the region r > 10, the correlation turns into 
anti-correlation, since Ijj is negative, meaning that 
squirmers at least 10 r adii apart tend to swim in o p- 
posite direction. From Ishikawa and Pedlev 2008l |. 



around such organisms Short et al. . 2006| . 



5.1.2 The role of adhesion 

The problem regarding the mechanisms determin- 
ing tissue movements dates back to the beginning of 
the 20th century. In 1907 Wilson discovered that 
sponge cells which have been previously squeezed 
through a mesh of fine bolting-cloth are able to re- 
unite again rec onstituting th emselves into a func- 



tioning sponge [Wilsonl . Il907l | . Early studies mainly 



envisioned cell sorting as a resultant of inhomo- 
geneities (for example of pressure) in the immedi- 
ate environment. Since then many theoretical and 
experimental studies have been dedicated to this 
question supporting the idea that the movements 
are due to intrinsic properties of the individual tis- 
su es themselves (landmarked by, among many oth- 
ers Wilson and Pcnnev fl930l , Bronsted 'l936l . ' WeissI 



19411. iMoscana , 19521 . .Trinkaus and Groves [195E 



Weiss and Tavlod il960l |1. 

To explain the phenomenon of cell sorting. 
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Steinberg 1963| developed the hypothesis that the 
local rearrangement behavior (characterizing cells 
during the process of sorting out and tissue recon- 
struction) follows directly from their motility and 
quantitative differences in adhesiveness. (This the- 
ory is often referred to as "differential adhesion 
hypot hesis", DAH). Based on the basic ideas of 
DAH. lBelmonte et al. 2008l | introduced a simple self- 
propelled particle model to study cell sorting (see Sec. 

Regarding the collective motion and phase tran- 
sition observed in migrating ker atocyte cells (cells 
taken from the scales of goldfish) , ISzabo et~ 2006{ 
constructed a model describing their experimental 
observations (see also Sec. 13. 4|) . Using long-term 
video-microscopy they observed kinetic phase tran- 
sition from disordered to ordered state, taking place 
as the cell density exceeds a relatively well-defined 
critical value. Short-range attractive-repulsive inter- 
cellular forces are suggested to account for the orga- 
nization of the motile keratocyte cells into coherent 
groups. 

Instead of applying an explicit averaging rule 
(which would not be realistic), the model-cells (self- 
propelled particles) adjust their direction toward the 
direction of the net-force acting on them (see Eq. 
(|45|l ). In this two-dimensional fiocking model, N 
SPPs move with a constant speed vq and mobility 
/X in the direction of the unit vector ni(t) while the 
i and j particles experiences the inter-cellular force 
F{fi'rj). The motion of cell i{£ 1, . . . , N) in the po- 
sition ■ri{t) is described by 

dn{t) 



dt 



VQUi (t) 



N 



I' 3) 



(45) 



The direction ni{t) can be described by 6',"(i) as 
well, which attempts to relax to Vi{t) — dfi{t)/dt 
within a relaxation time r. Denoting the noise by ^ 
and the unit vector orthogonal to the plane of motion 
by e;. 



d0?{t) 1 

— —arcstn 

dt T 



\vi{t)\ 



+ ? (46) 



Figure 48: Computer simulations obtained by solv- 
ing Eqs. (^5)) and (021) for different particle densities. 
In agreement with the observations, the model ex- 
hibit a continuous phas e transition from disordered 
to ordered phase. From Szabo et al. 2006l |. 



Figure |48] shows the typical simulation results ob- 
tained by solving Eqs. pS)) and with periodic 
boundary conditions. The model - in good agree- 
ment with the observations - exhibit a continuous 
phase transition from disordered to ordered phase. 
(For the corresponding observations see also Fig. [17] 
in Sec. 

Some authors put much emphasis on the actual 
shape and plasticity of the cells as well, since these 
properties also play an import ant role in the emer- 
gent behavior of the system 



Glazier and Graner. 1993 



Graner and Glazier 



Savill and Hogewee 



1992 

1997 j_ Maree and Hogewed. 12001 [ . Following this line, 
Rappel et al . 1999J suggested a model consisting of 
self-propelled deformable objects to explain their ex- 
perimental results on the dynamics of Dictyostelium 
discoideum (see also in Sec. 13. 4|) . Their model repro- 
duces the observed self-organized vortex states (the 
"pancake" -structures), as the resultants of the cou- 
pling between the self-generated propulsive force and 
the cell's configuration, and of the cohesive energy 
between the cells. 

A number of recent interdisciplinary studies fo- 
cus on the detailed mechanisms by which organ- 
isms - from bacteria to vertebrates - generate so- 
phisticated multicellular patterns (for example or- 
gans) during on togenesis. We men tion a representa- 
tive example bv lCzirok et al. 2008| who investigated 
the formation and regulation of multicellular sprout- 
ing during vasculogenesis. Based on in vivo and in 
vitro observations and experiments, they suggested 
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a general mechanism that builds on preferential at- 
traction/attachment to elongated structures. The 
proposed interactive particle model exhibits robust 
sprouting dynamics and results in patterns that are 
similar to native primordal vascular plexuses - with- 
out any assumptions involving mechano-chemical sig- 
n aling or chemotaxis. 



Wang and Wolvnea 201 ij proposed a model for 



structures like the cytoskeleton, that is, for systems 
consisting of many interacting bio-macromolecules 
driven by energy-consuming motors. Readers inter- 
ested in t he models of ac t ive po lar gels will find more 



details in Jiilicher et al. \. \2mi\ . 



5.1.3 Swarming bacteria 

By using models and simulations, experimentally ob- 
served behaviors which are seemingly unintelligible 
might also be elucidated. Recently, as described in 
Sec. 13.31 bacteria belonging to Myxococcus xanthus 
swarms were observed to reverse their gliding di- 
rections regularl y, while the colony itself expanded 
Wu et all . l2009l | . To compass this seemingly energy- 



wasting behavior, the authors simulated the observed 
phenomena using a cell-based model, taking into ac- 
count only the contact-mediated, local interactions 
Wu et al.l . l2007| . The individual cells are represented 
by a flexible string of N nodes, consisting of A'^ — 1 
segments, as depicted on Fig. |49] (basically a bend- 
able rod, bended in iV — 2 points, being able to move 
in 2-D space). Each segment has the same length 
r. In the simulations N was chosen to be 3, thus 
each cell had two segments, as the rod was blended 
in one point, in the middle. The orientations of the 
cells are defined by the vectors directed from the tail 
nodes to the head nodes. In order to keep the shapes 
of the cells within an interval that agrees with the 
observations, a Hamiltonian function was defined to 
characterize the certain node-configurations, as given 
byEq. (j47|. 



neighboring segments i and i + and Kg are the 

stretching and the bending coefficients, respectively, 
defining the extent to which the length of the seg- 
ments and the angles between them can vary. Both 
of them are dimensionless values, and are the same 
for all the segments and angles. 

Regarding the active motion of the certain cells, 
first the head-node moves in a particular direction, 
followed by the other nodes which take positions so 
that the Hamiltonian function belonging to the new 
configuration is minimal. Since according to the ob- 
servations, Myxococcus xanthus cells do not h ave any 
kind of long-range communicating systems [Kaiseii 
l2003j |. the model takes the interactions only among 
neighboring cells into account. 

The experimentally-observed reversals (sudden 
changes in the direction with 180°) are most proba- 
bly regulated by an internal biochemical clock, which 
is independent of the actual interactions of the given 
cell. Therefore, the model takes into account these 
reversals by simply switching the roles of the head- 
nodes and the tail-nodes, according to an internal 
clock. 

Simulations based on the above model did not re- 
sult in swarming of the non -reversing cells in con trast 



to the simpler mo dels by IPeruani et aD |2006l| and 



Ginelh et al.l|2010j . On the other hand, it was found 



N-2 



that the expansion rate of the colony depends on the 
length of the reversal period. Notably, the biggest 
expansion is obtained within the same time-period 
that was experimentally observed, that is « 8 min. 
The cellular motion and the emerged patterns deep 
inside the colony was also modeled. As it can bee 
seen on Fig. [50l the considered social interactions 
result an enhanced order regarding the collective cel- 
lular motion. It should be noted , that in a very re- 
cent preprint Peruani et al. 2010l | found signs of both 
ordering and clustering in experiments with a non- 
reversing, genetically modified mutant of a myxobac- 
teria strain. 

One of the earliest works on the collective motion of 
bacteria pointing out t he reason why such models are 



Kb{r, -ro) Kee^, (47) important, is done bv ICzirok et"al1 |l996i . The au 



where is the length of the «th segment, tq is its 
"target length" and Oi is the angle enclosed by the 



thors emphasized that the study of bacterial colonies 
can lead to interesting insights into the functioning of 
self-organized biological systems which rest on com- 
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Tail node 




Head node 



Figure 49: Each cell is represented by a string of 
N nodes. In the simulations = 3, thus the cells 
consist of two segments, enclosing the angle 0. The 
orientation is defined by the vecto r directed from t he 
tail node to the head node. FromlWa et al.l 12001 




Figure 50: Simulational results of the bacteria motion 
and pattern formation deep inside the colony, (a) In 
the initial setup the cells are randomly distributed, 
(b) The inner area of t he colony after 3 h of evolution. 
Adapted from lWu et a l. [2007]. 



the bacterial length to width ratio (the interaction 
is stronger for longer bacteria), and ^ indicates an 
uncorrelated noise. The term {'d{t))^ ^ represents the 
average direction of the cells in the neighborhood of 
particle i, in the radius e. 

For the simulations, a more simple, time- 
discretized form of Eq. (|48)) was used (Eq. [T3)) . 
which is valid if the rotational relaxation time is fast 
compared to the change of the locations, that is, if 
r << v^^/y/p. {p denotes the average bacterium 
density.) 

Eq. ([13]) can be interpreted as a "starting-point" 
which is to be refined according to the specific sys- 
tems. Here the noise takes values from the inter- 
val [—r]/2,r]/2] randomly, with uniform distribution. 
The Xi positions of particle i is updated in each time- 
step according to Eq. (|14p . 

Modifying the above model to be more system- 
specific, two changes were introduced: (i) the peri- 
odic boundary conditions were replaced with reflec- 
tive circular walls, and (ii) a short-range "hard-core" 
repulsion was introduced, in order to prevent the cells 
to aggregate in a narrow zone. In other words, if the 
distance among cells decrease under a certain value 
£* , then these cells will repel each other, and their 
direction of motion will be given by 



plex networks of regulation systems, since these are 
perhaps the simplest living systems exhibiting collec- 
tive behavior, governed by interactions that are sim- 
ple enough to be captured by mathematical tools. 

In this paper the authors, on the one hand, re- 
ported on their experiments with Bacillus subtilis 
(see also Sec. I3.3l and Fig. (TU]) and on the other hand 
introduced a step-by-step elaborated model, which is 
capable to describe the increasingly elaborated com- 
plex collective behavior. The simplest expression de- 
scribes the collective migration of the cells, which 
move with a fixed-magnitude velocity v in the di- 
rection characterized by i?, according to Eq. pS)) 



dt 



+ c 



(48) 



where 'di{t) is the direction of the ith bacterium at 
time t, T is the relaxation time, which is related to 



z?, (i -f At) = $ - J2 ^ (^1 (^) - 2^ it)) 

\ j¥'i;\^j-£'i<<^'\ 

(49) 

where $(r) gives the angle between its argument 
vector and a predefined direction (for example the x 
axis), and N = il/\u\. Simulations with low noise and 
high density show correlated rotational motion (see 
Fig. I51|) . in which the direction of the vortices can 
be either clockwise or anti-clockwise, as it is selected 
by spontaneous symmetry breaking. 

The above constraint (reflective circular wall) is an 
externally imposed coercion to the bacterium colony. 
At the same time, in real colonies vortices often can 
be observed far from the boundaries as well, thus the 
conflnement of the bacteria must be the resultant of 
some kind of interactions among the cells. Accord- 
ingly, the model can be further elaborated by adding 



58 



5 MODELING ACTUAL SYSTEMS 




Figure 51: A stationary state of the system char- 
acterized by short-range repulsion among the cells 
(defin ed by Eg. (149 II) us ing reflective circular walls. 
From ICzirok et alj |l996| . 



"chemoattractants" to the system, which are inter- 
preted in a broad sense: they can be reactions on 
"passive" physical forces as well (like surface tension, 
efficiency of the flagella-motors) which depend on the 
deposited extracellular slime. Cells slightly alter their 
propulsion forces according to the local concentration 
of the attractant, which results in a torque acting 
on the colony. To simulate the system that includes 
the above introduced attractants, the concentration 
field, ca (describing the concentration level of the se- 
creted chemoattractants in each point of the field) 
is discretized by a hexagonal lattice (see Fig. [52]) . 
Supposing that a group of bacteria, a "raft" , is held 
together by intercellular bonds, it can be treated as a 
rigid body of size d. In this case, the velocity differ- 
ence Av at the opposite sides of the raft, in a linear 
approximation, is proportional to that component of 
Vca which is orthogonal the velocity v: 



Av 



-\v X Vca\ 

V 



(50) 



By neglecting the convective transport caused by 
the motion of bacteria, the chemoattractant field's 
time evolution can be written as 



dc 



dt 



= Da^^ca 



Tap - Aaca, 



(51) 



Xa is the constant rate of the decay, p denotes the 
local density (number of particles in a unit area) 




Figure 52: The discretized concentration field: a 
hexagonal lattice defined by the lattice vectors 
ei, 62, . . . , eg. The open circles in the middle of the 
hexagons are those points where the concentration 
level of the diffusing chemoattractants are calculated 
at each time-step. The thick line shows the boundary 
of the system, which reflects the particles (filled dots) 
which can move off-lattice. To define the average di- 
rection {v)^ ^ for the bacterium i in lattice-cell A, the 
avera ging involves all th e particles in cells A — G. 
FromlCzirok et al.l Il996l. 



and T A is the rate by which bacteria produce the 
chemoattractant material. The first term represents 
the diffusion. 

Figure [53l depicts a typical snapshot of the simula- 
tions. The secretion of chemoattractants is a process 
with positive feedback effect, which breaks down the 
originally homogeneous particle distribution and re- 
sults denser clusters in sparser regions. 

In dense colonies of Bacillus subtilis - in which 
hydrodynamical effects (the effect of the medium 
through hydrodynamic interactions) play a signifi- 
cant role - a surprising behavior can be observed: 
in regions of high bacterium concentration (having at 
least 10^ cells per cm?) transient jet-like patterns and 
vortices appear. The latter ones persist for timescales 



of « Is Mendelson et al. . 19991 Dombrowski et al 



«pi 

m 



The speed of the observed jets are typically 
larger than that of the individual bacteria . To eluci- 
date these observations, Wolgemuth 2008| developed 
a two-phase model in which the fluid and the bacteria 
were modeled by two independent, but interpenetrat- 
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Figure 53: Typical vortices formed by the model in- 
volving chemoattractants. The originally homoge- 
neous particle distribution is destroyed by the pos- 
itive feedback effect of the attractants. Arrows show 
the coarse grained velocity of the bacteria, while 
the corresponding distribution of the chemoattrac- 
tant concentration is depicted in the upper left cor- 
ner. From I Czirok et a l. [1996]. 



ing continuum phases. Since their propulsive motors 
(the flagella) do not act on the center of mass, the 
rod-shaped bacteria exert a dipole force on the fluid. 
For reasonable parameter- values, the model (a sys- 
tem of partial differential equations) reproduces the 
observed behavior qualitatively. Figure [M] represents 
the onset of the observed turbulent behavior with the 
jets and vortices. 

The interaction between these organisms under 
similar circumstances (namely, closely packed pop- 
ulations of Bacillus subtilis) with one other and 
with the boundarie s (walls) is in the focus of 
Cisneros et all [2007| . Their model swimmer consist 
of a sphere (which is the "body" of the cell) and a 
cylinder representing the rotating bundle of helical 
flagella (see Fig. [55]). The occurrence of the turbu- 
lent states at small Reynolds numbers (at Re << 1) 
is explained by the energy that the bacteria insert 
in to the fluid as they swim in it. 

Czirok et al.l 2001 1 used coupled differential equa- 
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Figure 54: (Color online) Four snapshots of the model 
reproducing the onset of the experimentally observed 
jets and vortices. The color map indicates the bac- 
terial volume fraction, and the little arrows denote 
the fluid velocity field. According to the initial con- 
ditions (t = 0), the bacteria are distributed uni- 
formly and the fluid velocity field is directed (with a 
small random per turbation) along the x axis. From 
IWokemuthl |2008l| . 



tions to describe experimentally observed patterns 
of bacterial colonies. With such a method, they 
captured the periodic growth of Pro teus mirabilis 
coloni es (see Fig. [T3] in Sec 



Volfson et al.l 



2008| emphasized the role of bio-mechanical inter- 



actions arising from the growth and division of the 
cells (see also Fig. [15] in Sec. 13. 3p . and developed 
a continuum model based on equations for local cell 
density, velocity and the tensor order parameter. 

Reade rs interested in thi s field will find more de- 
tails in [Lauga and Powers . l2009j and in [IshikawaL 



5.2 Models with segregating units 

Cell sorting denotes a special type of collective mo- 
tion during which an originally heterogeneous mix- 
ture of cells segregate into two (or more) homoge- 
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new orientation 0^^^ of particle n is 



Figure 55: (Color online) Streamlines of the fluid ve- 
locity field surrounding a group of five bacterium near 
to the walls. As it can be seen, there is little front-to- 
end penetration of the fiuid into the group. Remark- 
ably, as the authors point it out, this circumstance 
can lead to the split-up of a group because, as it 
follows, the oxygen supply for the organisms within 
a phalanx consisting of many bacteria will be insuf- 
ficient, thus the inner cells will alter their velocity 
accor ding to the gradient of oxygen concentration. 
From ICisneros et al.l 2007 1. 



neous cell clusters without any kind of external field. 
This can be observed, for example, during the devel- 
opment of organs in an embryo or during regenera- 
tion afte r tissue dissocia t ion. To simulate this phe- 
nomena, Belmonte et al.l 2008l | considered two kinds 



of cells, differing in their interaction intensities. Ac- 
cording to the model, N particles move in a two- 
dimensional space with constant vq velocity. The ve- 
locity and the angle of the orientation of particle n 
at time t is denoted by and 6*^, respectively. The 



Qt+l 



arg 



E 



OLn 



nrnJnm 



(52) 

where the summation refers to those particles (m) 
which are within a radius vq. These 'cells' exert a 
force fnm^nm '^^ '^j along the direction e^^. The 
noise is taken into account by u^^, which is a random 
unit vector with uniformly distributed orientation. 
anm and are the control parameters: a controls 
the relative weights of the alignment interaction, and 
/3 shows the strength of the radial two-body forces 
/nm, which is defined as 



if ^nra ^ ^cj 

if Tc < rnrn < Tq, 

if rnm > ro, 



(53) 



that is, for distances smaller than a core radius rc, 
it is a strong repulsive force, around the equilibrium 
radius it is a harmonic-like interaction, and for dis- 
tances bigger than the interaction range rp it is set 
to zero. For modeling the o bservations regarding Hy- 
dra cells Rieu et al. r i200fl| . the authors defined two 
kinds of particles, "endodermic" and "ectodermic" , 
denoted by 1 and 2, respectively. Accordingly, /3ii 
and /?22 stand for the cell cohesion within the two 
cell-types, while /?i2 and /32i account for the inter- 
cell-type interactions. These latter ones are assumed 
to be symmetric, that is, /3i2 = /32i- For the sake of 
simplicity, all the cells have the same a value. Figure 
[5S1 shows how a group of 800 cells evolve in time. The 
proportion is 1:3 of endodermic (black) to ectodermic 
(gray) cells, and a=0.01. 

Segregation occurs in various 3D systems as well, 
such as in flocks of birds or schools of flsh. Mostly, 
models assume identical particles to simulate col- 
lective motion. At the same time, those simula- 
tion s which suppose diverse particles, exhib it sort- 
ing Romev . 1996 . Couzin and Krausa 2003l |. This 
means that behavioral and/or motivational differ- 
ences among animals effect the structure of the group, 
since individuals change their positions relative to the 
others according to their actual inner state. This in- 
volves that if the individual variations are persistent 
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Figure 56: Cell sorting of 800 cells. The endoder- 
mic cells are represented by black, and the ectoder- 
mic ones by gray circles, respectively, (a) The initial 
cluster with mixed cell types, (b) the cluster after 
3000 time step, and (c) is taken at t = 3 x 10^. Clus- 
ters of endodermic cells form and grow as time passes 
by. {d) t — 2 X 10^. A single endodermic cluster is 
formed, but some isolated cells remain within the ec- 
toderm tissue, in agree ment with the experime nts of 
Rieu et al.l |l998l| . From iBelmonte et all |2008 | 



then the group will reassemble to its' original state 
after perturbations [Couzi n et al.l . 2002 1. The sorting 



phenomenon depends primarily on the relative differ- 
ences among the units. 



In a similar spirit, IVab0 and Skaretl |2008l | showed 
that differences in the motivational level can cause 
segregation within a school of spawning herrings. 
They used an individual based model in which the 
parameters describing the states of the individuals 
were varied and they measured a range of parame- 
ters at system level. The motion of each individual 
was determined by the combination of five behavioral 
rules: (1) avoiding boundaries, (2) social attraction, 
(3) social repulsion, (4) moving towards the bottom 
to spawn and (5) avoiding predation. The motiva- 
tional level was controlled by a parameter. To cap- 
ture how the system as a whole reacts on changes in 
the individual level, various metrics were recorded, 
like the size and age of the school, its vertical and hor- 
izontal extension, etc. By varying the size of the pop- 



ulation and the level of the motivational synchroniza- 
tion, different systems emerged regarding its mor- 
phology and dynamics. Similar motivational levels 
resulted in an integrated school, whereas diverse in- 
ner states produced a system with frequent split-offs. 
More complex structure appeared by an intermediate 
degree of synchronization characterized by layers con- 
nected with vertical cylindrical shaped schools (see 
Fig. I57|) allowing ovulating and spent herring to move 
across the laye r s, in a greement with the observations 



Axelsen et al. . 2000| . These findings suggest that 



the level of motivational synchronization among fish 
determines the unity of the school. Furthermore, this 
study also demonstrates that larger populations can 
exhibit such emergent behaviors that smaller ones 
can not (for example the cylindrical bridges men- 
tioned above). 

Mor e general simula tions also support these re- 
sults. You et al. 2009| investigated the behavior of 
two-component swarms, consisting of two different 
kinds of particles, varying in their parameters, such 
as mass, self-propelling strength or preferences for 
shelters. The units, having different parameter-set, 
were observed to segregate from each other. 

Other experiments focus on the emergent patterns 
of particles having different kinetic parameter set- 
tings (preferred speed, the range of perception in 
which a particle perceives th e velocity vectors of o ther 
particles, etc.). The studv of lSavama et al. 2009| was 
prompted by an in-class experiment aiming to test 
a new version of a software called "Swarm Chem- 
istry" which is an interactive evolutionary algo- 
rithm. 

The software assumes that the particles move in 
an infinite two-dimensional space according to kin etic 
rules resembling to the ones introduced by iRevnoldsl 
1987| (see Sec. The strength of these kinetic 



rules, as well as the preferred speed and the local per- 
ception range, differ from particle to particle. Those 
units that (accidentally) share the same parameter- 
set, are considered to be of the same type. Some 
snapshots of the emergent dynamic patterns that 
these particles produce with their various parameter- 



*it can be downloaded from the author's website, 
http: / /bingweb.binghamton.edu/'sayama/SwarmChemistry/ 
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Figure 57: (Color online) Simulational results, in 
which the motivational level of the individuals are 
taken into account. Large herring populations with 
small motivational synchronization tend to form 
multi-layered schools in which the layers are con- 
nected by cylindrical shaped "bridges" . The moti- 
vational level depends primarily on the age of the 
fish: mature herrings are denoted with yellow color 
(online), ovulating ones are orange to red, spawning 
individuals are black and white color reg isters spent 



herring. Adapted from lVabo and Skareti |2008i] 



sets, can be seen on Fig. [551 

According to the simulations, these mixtures of 
multiple type units usually spontaneously undergo to 
some kind of segregation process, often accompanied 
by the appearance of multilayer structures. Further- 
more, the formed clusters may exhibit various dy- 
namic macroscopic behaviors, such as oscillation, ro- 
tation or linear motion. 

Interestingly, simulati ons of hun ting showed segre- 
gation as well {Kamimura and Ohira . 201i| . Here the 
two kinds of particles were the chasers (or predators) 
and the targets (or preys) which differed in their be- 
havior. 

5.3 Models inspired by animal behav- 
ioral patterns 

5.3.1 Insects 
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Figure 58: (Color online) Some snapshots of 
the emergent patterns that particles with differ- 
ent parameter-set (preferred speed, range of percep- 
tion and strength of the kinetic rules) can produce. 
From http : //bingweb . binghamton . edu/~sayama/ 
SwarmChemistry/#recipes. 



for in case of the depletion of nutrition al resources 
jSimpson et~al] . l2006lTBazazi et aLl . l2008| . Motivated 
by these observations, it can be shown that individu- 
als with escape and pursuit behavior-patterns (which 
special kind of repulsive and attractive behaviors can 
be cor related with cannibalism ) exhibit collective mo- 
Romanczuk et al. . 2009| . The escape reaction 



As mentioned in Sec. 13. 5[ Mormon crickets and 
Desert locusts tend to exhibit cannibalistic behav- 



tion. 

is triggered in an individual if it is approached from 
behind by another one; in this case the escaping an- 
imal increases its velocity in order to prevent being 
attacked from behind. In contrast, if the insect per- 
ceives one of its mates moving away, it increases its 
velocity in the direction of the escaping one; this is 
the pursuit behavior. Other cases do not trigger any 
response. According to the simulations, at moder- 
ate noise intensity and high particle density, these 
interactions (pursuit and escape) lead to global col- 
lective motion, irrespective of the detailed model pa- 
rameters (see Fig. [59| . Both interaction- types lead 
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lective locust motion is their sudde n, coherent 
switches in the direction of motion. Yates et al. 



[2009| suggested to use Fokker-Plank equations in 
order to describe these observations. They found 
a seemingly counterintuitive result, namely that the 
individual locusts increased their motional random- 
ness as a reaction for a loss of alignment in the 
group. This reaction thought to facilitate the group 
to find a highly aligned state again. They also 
found that the mean switching time increased expo- 
nentially with t he nu mber of individuals. Recently 
Escudero et al. 2010| suggested that these ergodic 



p + e 



directional switches might be the resultants of the 
small errors that the insects make when trying to 
adopt their motion to that of their neighbors. These 
errors usually cancel each other out, but over expo- 
nentially long time periods they have the possibility 
of accumulating and producing a switch. 



Figure 59: The global collective motion emerging 
from escape and pursuit behaviors, ps is the rescaled 
density, which is defined as Ps = Nll/L?, where N 
is the total number of the individuals, Is is their 
interaction range and L is the size of the simula- 
tion field. The simulations were carried out by us- 
ing periodic boundary conditions. The column de- 
noted by p shows the typical spatial configurations 
for the pursuit-only case, e for the escape-only case, 
and p + e when both interactions are present. The 
large arrows indicate the direction and speed of the 
mean migration. As it can be seen on the top row, at 
low rescaled densities the emergent patterns strongly 
vary according to the st rength of the escape and pur- 
suit interactions. From Romanczuk et al.l 



peand 
T |2n09j . 



to collective motion, but with an opposite effect on 
the density distribution. Whereas pursuit leads to 
density-inhomogeneities (that is, to the appearance 
of clusters, as it can be seen on the first column on 
Fig. [59|) . escape calls to forth homogenization. Thus, 
the collective dynamic in which both behavior-types 
are present, is a competition between the two oppo- 
site effects. 

Another often observed phenomena regarding col- 



5.3.2 Moving in three dimensions fish and 
birds 

The main goal of the first system-specific models aim- 
ing to simulate the motion of animals moving in 3 
dimensions (primarily birds and fish) w as to pro- 
duce realistically looking collective motion Reynold^ . 
1987[, to give system-speci fic models taking into 
accou nt many parameters jMcFarland and Okubd . 
1997[, or to create systems in which some charac- 
teristics (for example nearest neighbor distance or 
density) resembles to an actual biological system 



Huth and Wissell . Il994| . Later various other aspects 
and features were also studied, such as the func- 
tion and mechanis m of line versus cluster f orma- 
tion in bird flocks Baiec and Heppner . 2009{ . how 
the fish size and kinship correlates with the spatial 
characteristics (e.g., anima l density) of fish schools 
Hemelriik and Kunj . 2005 1. the effect of social con- 



nections ("social network") on the collective motion 

I ' 1 r ' 

of the group ' Bode et al .. 2011bl, the cohort depar- 
ture of bird flocks Heppner . .1997] , the collective be- 
havior in an ecological context (in which not only the 
external stimuli, but the internal st ate of the individ- 
uals are also taken into account) IVab0 and Skaret . 
2008 1. or the effect of perceived threat Bode et al. . 
2010|. This latter circumstance was taken into ac- 
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count by relating it to higher updating frequency, and 
it resulted a more synchronized group regarding its 
sp eed and nearest neighbor d istribution. The book 
of Parrish and Hamned |l997l | provides an excellent 
review on this topic. 

Models proposed by biologists tend to take into ac- 
count many of the biological details of the modeled 
animals. A good example fo r this kind of approach is 
the ve ry interesting work of Heppner and GrenandeJ 
|l990| | , who proposed a system of s tochastic differen- 
tial eq uations with 15 parameters. iHuth and Wisse 
1992j used a similar approach for schools of fish. 



Some other models included a more realistic represen- 
tatio n of body size and shape Kunz and Hemelriikl . 
120081 1 . 

Regarding the methodology of most of the simula- 
tions, the agent-based (or individual-based) approach 
proved to be very popular (alth ough there are a l- 
ternative approaches as well, e.g., lHavakawal|20inj 'l. 
The reason behind this is that this approach pro- 
vides a link between the behavior of the individuals 
and the emergent properties of the swarm as a whole, 
thus appropriate to investigate how the properties of 
the system depend on the actual behavior of the in- 
dividuals. The most common rules applied in these 
models are: (i) short-range repulsive force aiming to 
avoid collision with mates and with the borders, (ii) 
adjusting the velocity vector according to the direc- 
tion of the neighboring units, (iii) a force avoiding 
being alone, e.g., moving towards the center of the 
swarm's mass, (iv) noise, (v) some kind of drag force 
if the medium is considered in which the individuals 
move (which is usually not taken into account, in case 
of birds and fish) . Then, the concrete models differ in 
the rules they apply (usually most of the above ones) , 
in their concrete form and in the system parameters. 

Some biologically more realistic, yet still sim- 
ple individua l- based i nodels were also suggested 



Couzin et al. , 2002 , Hemelriik and Hildenbrandtl . 



20081. In a computer m odel called 'StarDisplay', 
Hildenbrandt et al. 2010l l combined the above men- 
tioned "usual rules" with system specific ones in or- 
der to generate patterns that resemble to the aerial 
displays of starlings, recorded by the Starflag project 

fs ee Sec. [3Jll. 

Couzin et al.l 2002l | categorized the emergent col- 



lective motions as the function of the system pa- 
rameters. In this framework, the individuals obey 
to the following basic rules: (i) they continually at- 
tempt to maintain a certain distance among them- 
selves and their mates, (ii) if they are not performing 
an avoidance manoeuvre (described by rule i), then 
they are attracted towards their mates, and (iii) they 
align their direction to their neighbors. Their percep- 
tion zone (in which they interact with the others) is 
divided into three non-overlapping regions, as illus- 
trated in Fig. [SOI The radius of these spheres (zone of 
repulsion, zone of orientation and zone of attraction) 
are Rr, Ro and i?a, respectively. Thus, the width 
of the two outer annulus are A/?o = Ro — Rr and 
ARa = Ra — Ro- Oi denotes the field of perception, 
thus, the "blind volume" is behind the individual, 
with interior angle (360 — a) . 

In order to explore the global system behavior, the 
authors analyzed the consequences of varying certain 
system parameters, like the number of individuals, 
preferred speed, turning rate, width of the zones, etc. 
For every case, the following two global properties 
were calculated: 



Loit) = — 



N 



4=1 



(54) 



where iV is the number of individuals within the 
group, (i = 1,2,..., N), and vf{t) is the unit direc- 
tion vector of the ith animal at time t. (Since vf{t) 
is a unit vector, the expression defined by Eq. (j54[) is 
equivalent with the order parameter defined by Eq. 
©•) 

The other measure, group angular momentum, 
is the sum of the angular momenta of the group- 
members about the center of the group, fcr- This ex- 
pression measures the degree of rotation of the group 
about its center 



merit) = — 



N 



J2n^Gr{t)xvf{t) 

1=1 



(55) 



where fi-cr = — ^Gr, is the vectorial difference of 
the position of individual i, fl, and the position of 
the group-center, for- 
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Figure 60: The interaction zones, centered around 
each individual. The inner-most sphere with radius 
Rr is the zone of repulsion ("zor"). If others en- 
ter this zone, the individual will response by moving 
away from them into the opposite direction, that is, 



it will head towards — {f 



\)/\rj 



where 



rij. in the number if individuals being in the zor. The 
interpretation of this zone is to maintain a personal 
space and to ensure the avoidance of collisions. The 
second annulus, "zoo" , represents the zone of orien- 
tation. If no mates are in the 'zor', the individual 
aligns itself with neighbors within this 'zoo' region. 
The outermost annulus, "zoa" , is the zone of attrac- 
tion. The interpretation of this region is that group- 
living individuals continually attempt to join a group 
and to avoid being alone or in the periphery. From 
ICouzin et all [20021 . 



1 ^ 

i=l 



(56) 



Figure [nH summarizes the four "basic types" of col- 
lective motions emerged according to the various pa- 
rameter setups. 

^^Swarm:^^ Both the order parameter (ip) and the 
angular momentum {mcr) are small, which means 
little or no parallel orientation. (Fig. [611 (a) sub- 
picture.) 

^^Torus^^ or "milling": Individuals rotate around an 
empty core with a randomly chosen direction. The 
order parameter (ip) is small, but the angular mo- 
mentum {mQr) is big. This occurs when Ar^ is big. 




Figure 61: The "basic types" of collective motions 
exhibited by the model, according to the various pa- 
rameter setups. The denominations are: (a) swarm, 
(b) torus, (c) dynamic par allel group, (d ) high ly par- 
allel group. Adapted from Couzin et al.l |2002| . 



but Afo is small. (Fig. (b) sub-picture.) 

^''Dynamic parallel group:^^ Occurs at intermediate 
or high values of Ara and intermediate values of Aro. 
This formation is much more mobile than either of 
the previous ones. The order parameter (ip) is high 
but the angular momentum {mGr) is small. (Fig. 1611 
(c) sub-picture.) 

Highly parallel group By increasing Aro, a 
highly aligned formation emerges characterized by 
very high order parameter {(p) and low angular mo- 
mentum (mcr). (Fig. im (d) sub-picture.) 

However, the approach of individual (or agent) 
based modeling has its own limitation s or "traps" - as 



pointed out by lEriksson et al. 2010j . Namely, that 



different combinations of rules and parameters may 
provide the same (or very similar) patterns and col- 
lective behaviors. Accordingly, in order to prove that 
the emergent behavior of a certain biological system 
obeys given principles, it is not enough to provide a 
rule and a parameter set (modeling these principles) 
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and demonstrate that they rep roduce the observed 
behavior. (On the other hand, Couzin et al. |2002 ^ 
demonstrated that - vice versa - the same rule and 
parameter set may result in different collective behav- 
ior in the very sa me system, depend iuK on its recent 
past, "history".) Yates et al. 2009{ note that many 
models have weak predictive power concerning the 
various relevant aspects of collective motion, includ- 
ing, for example, the rate at which groups suddenly 
change their direction. 

5.4 The role of leadership in consen- 
sus finding 

Animals traveling together have to develop a method 
to make collective decisions regarding the places of 
foraging, resting and nesting sites, route of migration, 
etc. By slightly modifying (typically extending) mod- 
els (such as the one described in Sec. 15.3.21) . a group 
of ind ividuals can get hol d of such abilities. Accord- 
ingly, ICouzin et al. 2005 1 suggested a simple model 
in which individuals were not required to know how 
many and which individuals had information, they 
did not need to have a signaling mechanism and no 
individual recognition was required from the group 
members. Informed individuals were not necessitated 
to know anything about the information-level of their 
mates either and that how the quality of their infor- 
mation was compared to that of others. The model 
looks as follows: 

A'^ individuals compose the group. The position 
of the ith particle is described by the vector fi, and 
it is moving in the direction Vi. The group mem- 
bers endeavor to continually maintain a minimum 
distance, a, among themselves, by turning away from 
the neighbors j which are within this range towards 
the opposite direction, described by the desired di- 
rection dj 



\rj{t)-Mt)\ 



(57) 



This rule has the highest priority. If there are 
no mates within this range, than the individual will 
attempt to align with those neighbors j, which are 



within the interaction range p. If so, the desired di- 
rection is defined as 



rj{t)-n{t) 
\rj{t)-n{t)\ 



E 



ML 

\vAt)\' 



(58) 



We will use the corresponding unit vector, di{t) = 
d,lt)/\d,lt)\- 

Until this point the algorithm is very similar to 
the one described in Sec. 15.3.21 In order to study 
the influence of informed individuals, a portion of 
the group, p, is given information about a preferred 
direction, described by the unit vector g. The rest of 
the group is naive, without any preferred direction. 
Informed individuals balance their social alignment 
and their preferred direction with the weighting fac- 
tor w 



d^{t + At) 



d,{t + At) + ujg. 



d,{t + At)+ujg, 



(59) 



(cj can exceed 1; in this case the individual is influ- 
enced more heavily by its own preferences than by 
its mates.) The accuracy of the group (describing 
the quality of information transfer) is characterized 
by the normalized angular deviation of the group di- 
rection around the preferred direction g, similarly to 
the term given in Eq. 1551 

The authors found that for fixed group size, the 
accuracy increases asymptotically as the portion p of 
the informed members increased, see Fig. 1621 This 
means, that the larger the group, the smaller the por- 
tion of informed members is needed, in order to guide 
the group towards a preferred direction. 

However, informed individuals might also differ in 
their preferred direction. If the number of individuals 
preferring one or another direction is equal, than the 
group direction will depend on the degree to which 
these preferred directions differ from each other: if 
these preferences are similar, then the group will go 
in the average preferred direction of all informed in- 
dividuals. As the differences among the preferred di- 
rections increase, individuals start to select randomly 
one or another preferred direction. If the number of 
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Figure 62: (Color online) SPPs following simple rules 
can compose systems in which a few informed individ- 
ual is capable to guide the entire group towards a pre- 
ferred direction. The accuracy of the group (follow- 
ing the rules given by Eqs. \57\ [58] and \E9\\ increases 
asymptotically as the portion of the informed indiy id- 
uals increases. Adapted from ICouzin et al.l 2005 [. 



informed individuals preferring a given direction in- 
creases, the entire group will go into the direction 
preferred by the majority, even if that majority is 
s mall (see Fig. l63|. 

Freeman and Birol 2009| extended this model by 
including a "social importance factor" , h, describing 
the strength of the effect of a given individual on the 
group movement. That is, h varies with each agent, 
and the higher this value is, the bigger influence the 
given unit exerts on the group. Equation 1581 is mod- 
ified accordingly 



-El-. 



(60) 



These models show that leadership might emerge 
from the differences of the level of information pos- 
sessed by the group members. Importantly, since 
the information can be transient and different group 
members may have pertinent information at different 
times or in different contexts, leadership can be tran- 
sient and transfera ble as well. Other st udies also sup- 
port these results. Quera et al. 2010l | used an other 
kind of rule-set by which their agents moved, and 
observed the same: certain agents did become lead- 



Figure 63: (Color online) Collective group direction 
when two groups of informed individuals differ in 
their preferences. The vertical axis shows the de- 
gree of the most probable group motion. The first 
group (consisting of ni informed individuals) prefers 
the direction characterized by degrees (dashed line), 
while the second group (consisting of n2 informed in- 
dividuals) prefers a direction between 0— 180 degrees 
(horizontal axis). The group consists of 100 individ- 
uals altogether, of which the numbers of informed in- 
dividuals are (a) ni = n2 = 5, (b) ni = 6 and n2 = 5 
(c) ni = 6 and n2 
2005j . 



4. Adapted from ICouzin et al. 



ers without anything in the rule-set or in the initial 
conditions that would have prompted or predicted it. 

In addition, even simpler models can lead to con- 
sensus decisions. For example, the severe quorum 
rule (in which the probability that an individual fol- 
lows a given option, sharply increases when the num- 
ber of other group members making that very de- 
cision reaches a threshold) resu l ted a ccurate group 
decisions as well 



Sumpter et al.l . \200, 



Despite many attempts, the resear ch of "human de- 
cision making" is still in its infancy. ICastellano et al" 
|2009l | give a nice review of the state of the art regard- 
ing the physical and mathematical models which have 
been proposed throughout the year s in t he field of so- 
cial d ynamics. [Ramasw amv . 2010| and Toner et al 



20051 provide general informative reviews of the mod- 
els and approaches of collective motion. 

5.5 Relationship between observa- 
tions and models 

Throughout this review, we have discussed two kinds 
of models: one of them, reviewed in Sec. |4l consti- 
tutes the ones addressing the basic laws and charac- 
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teristics of flocking. In fact, the aim of these models 
is to give a minimal model, i.e., a description, includ- 
ing those and only those rules which are inevitable 
for the emergence of collective motion. All other as- 
pects are neglected, by design. The question these 
studies aim to clarify is the following: What are the 
necessary conditions for collective motion to appear 
and how the emergent behavior is affected by these 
terms? 

On the other hand. Sec. [5] comprises models which 
aim to apprehend a well-described observation as 
adequately as possible. In fact, a model is con- 
sidered to describe a phenomenon properly if it is 
capable of giving predictions, that is, the behav- 
ior of the observed system can be foretold by ap- 
plying the model. Since models ensure a deep in- 
sight into the observed phenomenon, many authors 



nying their experimental findings ( Keller and Seeell. 


1971. Czirok eta] 


.. 19961 Wu et all. l2009l 2007 


Czirok et al.l 2001 


, Rappel et al.l. 1999.ISzab6 et al. 


20061 ICouzin and Franksl. 20031 Buhl et al.l. 2006 


Rose et al.l. 20091) 


while other models give account 



for previou s ly re ported observations. As such, 
Wolgemiithl [2008l | developed a two-phase model in 
order to describe the jet-like patterns and vor- 
t ices appearing in dense colonies of Bacillus subtil is 



Mendelson et all. Il999l iDombrowski et al.l . l2004j ). 



Belmonte et al. 2008| proposed a model which gives 
account for the ce ll-sorting pheno menon observed in 



Hvd ra cells bv iRieu et al.l [2000j, or we can men- 
tion |^b^^^nd^S^reJ]20ol| who modeled the unique 
forms of herring schools observed by Axelsen et al. 
in 2000. 

Sometimes the theoretical calculations come be- 
fore the observations, i.e., the given model predicts 
a previously unreported phenomenon. As an exam- 
ple. Toner and Tu predicted the phenomenon of giant 
number fluctuation in their 1995, 98 p aper, which was 



observed more than a decade later by iNaravan et al, 
(2007| . These cases lend strong support for the mod- 
els giving the predictions. 

Overall, we conclude that a considerable number 
of evidences have accumulated each demonstrating 
that both qualitative and quantitative agreements 
between observations (of collective motion) and their 



theoretical/modeling interpretations can be estab- 
lished. 



6 Summary and conclusions 

From the continuously growing number of exciting 
new publications on flocking we are tempted to con- 
clude that collective motion can be regarded as an 
emerging field on the borderline of several scientific 
disciplines. Thus, it is a multidisciplinary area with 
many applications, involving statistical physics, tech- 
nology and branches of life sciences. Because of the 
nature of the problem (treating many similar enti- 
ties) studies in this field make quantitative compari- 
son with observations possible even for living systems 
and there is a considerable potential for constructing 
theoretical approaches. 

The results we have presented support a deep anal- 
ogy with equilibrium statistical physics. The essen- 
tial deviation from equilibrium is manifested in the 
"collision rule" : since the absolute velocity of the par- 
ticles is preserved and in most cases an alignment of 
the direction of motion after interaction is preferred, 
the total momentum increases both during individ- 
ual collisions and, as a result, gradually in the whole 
system of particles as well. 

The observations we have discussed can be suc- 
cessfully interpreted in terms of simple simulational 
models. Using models based on simplified units (also 
called particles) to simulate the collective behavior 
of large ensembles has a history in science, especially 
in statistical physics, where originally particles rep- 
resented atoms or molecules. With the rapid increase 
of computing power and a growing appreciation for 
'understanding through simulations', models based 
on a plethora of complex interacting units, nowadays 
widely called agents, have started to emerge. Agents, 
even those that follow simple rules, are more complex 
entities than particles because they have a goal they 
intend to achieve in an optimal way (for example, 
using as little amount of resources as possible). 

As a rule, models of increasing complexity are 
bound to be born in order to account for the inter- 
esting variants of a fundamental process. However, 
there is a catch. A really good model must both re- 
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produce truly life-like behavior and be as simple as 
possible. If the model has dozens of equations and 
rules, and correspondingly large numbers of param- 
eters, it is bound to be too specific and rather like 
an 'imitation' than a model that captures the few 
essential features of the process under study. 

Thus, if a model is very simple, it is likely to be ap- 
plicable to other phenomena for which the outcome is 
dominated by the same few rules. On the other hand, 
simplification comes with a price, and some of the 
exciting details that distinguish different phenomena 
may be lost. But, as any fan of natural life movies 
knows, collective behavior in nature typically involves 
sophisticated, occasionally amazing techniques aimed 
at coordinating the actions of the organisms to max- 
imize success. The art of designing models of reality 
is rooted in the best compromise between oversimpli- 
fication and including too many details (eventually 
preventing the location of the essential features). 

On the basis of the numerous observations and 
models/simulations we have discussed above, the fol- 
lowing conclusions can be made concerning the gen- 
eral features of systems exhibiting collective motion: 

• Most patterns of collective motion are universal 
(the same patterns occur in very different sys- 
tems) 

• Simple models can reproduce this behavior 

• A simple noise term can account for numerous 
complex deterministic factors 

• Global ordering is due to non-conservation 
of the momentum during individual colli- 
sions/interactions of pairs of units 

The universally occurring patterns can be divided 
into a few classes of motion patterns: 

• Disordered (particles moving in random direc- 
tions) 

• Fully-ordered (particles moving in the same di- 
rection) 

• Rotational (within a rectangular or circular 
area) 



• Critical (fiocks of all sizes moving coherently in 
different directions. The whole system is very 
sensitive to perturbations) 

• Quasi-long range velocity correlations and rip- 
ples 

• Jamming 

A few further, less widely-occurring patterns are also 
possible, for example in systems made of two or more 
distinctively different types of units. 

The following types of transitions between the 
above collective motion classes are possible: 

• Continuous (second order, accompanied with 
large fiuctuations and algebraic scaling) 

• Discontinuous (first order) 

• No singularity in the level of directedness 

• Jamming (transition to a state in which mobility 

is highly restricted) 

The above transitions usually take place as i) a 
function of density, or, ii) the changing magnitude 
of perturbations the units are subject to. The role of 
noise is essential; all systems are prone to be strongly 
influenced by perturbations. In some cases noise can 
have a paradoxical effect and, e.g., facilitate ordering. 
This could be understood, for example, as a result of 
perturbations driving the system out from an inef- 
ficient deterministic regime (particles moving along 
trajectories systematically (deterministically) avoid- 
ing each other) into a more efficient one, character- 
ized by an increased number of interactions. 

After reviewing the state of the art regarding col- 
lective motion, we think that some of the most ex- 
citing challenges in this still emerging field can be 
summarized as: i) Additional, even more precise data 
about the positions and velocities of the collectively 
moving units should be obtained for establishing a 
well defined, quantitative set of interaction rules typ- 
ical for most of the flocks, ii) the role of leadership 
in collective decision making should be further ex- 
plored. Is it hierarchical? Can a leadership-driven 
decision-making mechanism be scalabe up to huge 
group sizes? iii) The problem of a coherently-moving, 
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self-organized flock of unmanned aerial vehieles is still 
unsolved in spite of its very important potential ap- 
plications, iv) and last, but far from being the least, 
the question about the existence of some simple un- 
derlying laws of nature (such as, e.g., the principles 
of thermodynamics) that produce the whole variety 
of the observed phenomena we discussed is still to be 
uncovered. 

We have seen that using methods common in sta- 
tistical physics has been very useful for the quantita- 
tive description of collective motion. Theories based 
on approaches borrowed fluid dynamics, data evalu- 
ation techniques making use of correlations functions 
and many particle simulations all have led to a deeper 
insight into flocking phenomena. This is all in the 
spirit of going from a qualitative to a more quan- 
titative interpretation of the observations: a widely 
preferred direction in life sciences these days. 

A quantitative frame for describing the behavior of 
a system enables important, highly desirable features 
of treating actual situations. For example, prediction 
of the global displacement of huge schools of fish may 
have direct economic advantages. Understanding the 
collective reaction of people to situations including 
panic may lead to saving lives. Using computer mod- 
els to simulate migration of birds or mammals can 
assist in preserving biodiversity. The list of potential 
applications is long, and likely to get longer, espe- 
cially if we take into account the rapidly increasing 
interest in collective robotics. 
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